-- Logs begin at Tue 2022-05-10 13:12:32 UTC, end at Tue 2022-05-10 15:07:00 UTC. -- May 10 14:07:09.016146 dv-cinder-841125-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 14:07:09.025457 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 14:07:09 2022] *** May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: nodename: dv-cinder-841125-4-iscsi May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: machine: x86_64 May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: clock source: unix May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: pcre jit disabled May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: detected number of CPU cores: 4 May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: current working directory: / May 10 14:07:09.027472 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: detected binary path: /usr/bin/uwsgi-core May 10 14:07:09.028151 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: your processes number limit is 47680 May 10 14:07:09.028151 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: your memory page size is 4096 bytes May 10 14:07:09.028151 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: detected max file descriptor number: 2048 May 10 14:07:09.028151 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: lock engine: pthread robust mutexes May 10 14:07:09.028151 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: thunder lock: enabled May 10 14:07:09.028151 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 14:07:09.028151 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 14:07:09.072947 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: Python main interpreter initialized at 0x55d527e469c0 May 10 14:07:09.072947 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: python threads support enabled May 10 14:07:09.072947 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: your server socket listen backlog is limited to 100 connections May 10 14:07:09.072947 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: your mercy for graceful operations on workers is 90 seconds May 10 14:07:09.073292 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: mapped 403077 bytes (393 KB) for 2 cores May 10 14:07:09.073369 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: *** Operational MODE: preforking *** May 10 14:07:09.073604 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: *** uWSGI is running in multiple interpreter mode *** May 10 14:07:09.073604 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: spawned uWSGI master process (pid: 103317) May 10 14:07:09.073801 dv-cinder-841125-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 14:07:09.074375 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: spawned uWSGI worker 1 (pid: 103318, cores: 1) May 10 14:07:09.074709 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: spawned uWSGI worker 2 (pid: 103319, cores: 1) May 10 14:07:09.074862 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 14:07:10.289928 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:07:10.295509 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:07:11.038574 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:07:11.038574 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: from cryptography.utils import int_from_bytes May 10 14:07:11.038821 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:07:11.038821 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: from cryptography.utils import int_from_bytes May 10 14:07:11.039503 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:07:11.039503 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: from cryptography.utils import int_from_bytes May 10 14:07:11.039823 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:07:11.039823 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: from cryptography.utils import int_from_bytes May 10 14:07:13.681511 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:07:13.682101 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:07:13.682235 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:07:13.682599 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:07:13.682693 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:07:13.682790 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:07:13.682910 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:07:13.683006 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:07:13.683271 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:07:13.683367 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.683529 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:07:13.683632 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.683917 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.684012 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.684248 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.684342 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.684575 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.684664 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.684887 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.684981 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.685212 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.685315 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.685589 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.685848 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.686057 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.686324 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.686426 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.686655 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.686749 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.686982 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-4-iscsi {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.687074 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.687248 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.687340 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.687569 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.687663 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.687897 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-4-iscsi {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.687991 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.688217 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.688315 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.688527 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.688619 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.688840 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.688933 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.689150 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.689247 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.689458 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.689653 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.689817 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.690086 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.690267 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.690433 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.690614 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.690751 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.690940 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.691522 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.691630 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.691767 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.691852 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.691937 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692034 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692125 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692214 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692299 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692456 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692614 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692778 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.692932 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.693090 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.693332 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-4-iscsi {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.693470 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.693655 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.693750 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.693971 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.694100 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-4-iscsi {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.694313 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.694442 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.694727 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.694828 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.695047 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.695153 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.695364 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.695459 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.695689 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.695783 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.696016 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.696118 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.696330 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.696454 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.696657 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.696786 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.696979 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.697095 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.697301 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.697433 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.697624 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.697729 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.697927 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.698025 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.698260 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.698352 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.698575 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.698675 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.698895 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.698983 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.699203 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.699297 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.699511 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.699606 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.699766 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.699886 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.700081 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.700182 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.700378 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.700475 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.700688 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.700797 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.701559 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.701705 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.701851 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.702105 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.702306 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.702570 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.702702 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.702844 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.702959 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.703105 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.703227 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.703435 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.703556 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.703762 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.703883 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.704079 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.704205 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.704398 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.704520 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.706913 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707013 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707107 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707199 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707291 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707382 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707470 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707550 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707634 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707713 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707790 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707881 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.707967 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708056 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708135 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708213 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708213 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708361 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708361 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708502 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708590 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708679 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708770 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708851 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.708928 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709012 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709097 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709177 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709266 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709352 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709439 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709528 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709648 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709736 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.709957 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.710053 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.710293 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.710385 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.710628 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.710723 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.710956 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.711044 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.711265 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.711351 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.711519 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.711614 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.711827 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.711912 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.712138 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.712287 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.712427 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.712525 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.712731 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.712819 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.713041 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.713136 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.713353 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.713448 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.713657 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.713750 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.713965 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.714056 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.714297 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.714404 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.714600 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.714692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.714908 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.715001 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.715219 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.715314 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.715527 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.715619 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.715837 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.715925 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.716145 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.716232 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.716516 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.716682 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.717497 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.717707 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.717948 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.718060 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.718167 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.718308 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.718495 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.718616 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.718812 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.718928 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.719125 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.719239 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.719437 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.719559 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.719749 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.719879 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.720060 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.720203 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.720384 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.720523 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.720695 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.720835 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.721004 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.721138 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.721326 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.721461 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.721634 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.721761 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.721943 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.722071 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.722748 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.722846 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.722929 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723015 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723105 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723184 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723262 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723422 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723504 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723588 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723778 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.723892 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.724088 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.724185 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.724392 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.724480 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.724698 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.724784 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.725002 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.725089 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.725307 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.725391 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.725608 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.725694 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.725909 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.726008 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.726225 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.726314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.726535 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.726687 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.726837 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.726925 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.727156 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.727241 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.727480 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.727566 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.727788 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.727874 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.728096 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.728183 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.728403 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.728502 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.728724 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:07:13.728866 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.729062 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.729149 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.729396 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.729504 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.729734 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.729820 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.730050 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.730145 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.730391 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.730491 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.730722 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.730809 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.731047 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.731132 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.731361 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.731455 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.731678 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.731765 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.731994 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.732079 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.732483 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.732594 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.732862 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.732980 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.733200 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.733294 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.733527 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.733632 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.733851 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.733937 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.734178 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.734296 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.734517 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.734633 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.734844 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.734943 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.735179 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.735266 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.735498 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.735584 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.735813 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.735906 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.736143 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.736235 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.736469 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.736562 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.736783 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.736870 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.737114 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.737212 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.737441 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.737528 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.737758 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.737856 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.738073 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.738168 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.738415 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.738513 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.738729 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.738813 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.739043 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.739142 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.739358 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.739443 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.739682 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.739767 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.740004 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.740100 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.740319 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.740415 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.740639 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.740724 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.740956 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.741048 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.741271 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.741358 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.741586 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.741673 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.741903 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.741991 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.742236 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.742337 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.742575 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.742708 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.742893 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.742985 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.743209 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.743304 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.743526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.743613 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.743840 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.743935 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.744153 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.744241 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.744464 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.744560 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.744774 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.744863 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.745078 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.745184 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.745388 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.745501 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.745690 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.745790 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.746001 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.746087 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.746331 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.746505 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.746658 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.746748 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.746975 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.747070 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.747286 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.747381 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.747600 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.747696 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.747966 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.748079 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.748268 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.748543 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.748687 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.748903 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.749021 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.749226 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.749323 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.749540 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.749652 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.749861 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.749968 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.750177 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.750323 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.750510 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.750649 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.750824 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.750968 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.751140 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.751282 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.751450 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.751592 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.751785 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.751922 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.752094 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.752239 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.752400 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.752532 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.752747 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.752885 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.753041 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.753179 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.753321 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.753456 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.753618 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.753750 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.753930 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.754067 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.754264 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.754353 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.754581 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.754777 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.754899 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.755115 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.755241 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.755453 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.755576 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.755780 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.755877 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.756092 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.756198 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.756409 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.756527 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.756722 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.756847 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.757032 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.757155 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.757344 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.757469 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.757659 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.757776 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.757968 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.758082 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.758303 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.758394 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.758614 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.758705 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.758925 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.759011 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.759232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.759318 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.759559 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.759654 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.759874 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.760012 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.760182 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.760324 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.760496 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.760649 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.760807 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.760962 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.761154 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.761256 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.761466 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.761552 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.761814 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.761902 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.762157 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.762279 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.762511 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.762598 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.762843 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.762942 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.763164 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.763267 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.764004 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.764096 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.764335 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.764592 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.764844 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.764932 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.765171 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.765257 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.765494 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.765580 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.765824 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.765922 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.766147 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.766265 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.766738 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.766829 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.767064 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.767158 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.767381 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.767474 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.767700 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.767785 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.768013 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.768108 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.768327 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.768422 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.768639 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.768736 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.768966 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.769061 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.769275 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.769360 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.769595 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.769689 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.769936 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.770022 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.770292 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.770382 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.770615 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.770712 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.770939 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.771026 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.771258 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.771346 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.771576 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.771672 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.771888 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.771973 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.772208 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.772293 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.772522 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.772621 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.772836 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.772930 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.773160 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.773258 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.773472 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.773559 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.773784 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.773868 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.774093 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.774177 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.774441 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.774532 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.774751 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.774836 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.775071 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.775164 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.775377 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.775464 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.775691 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.775777 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.776018 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.776110 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.776351 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.776446 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.776661 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.776748 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.776976 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.777139 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.777295 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.777381 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.777604 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.777698 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.777915 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.778013 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.778245 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.778333 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.778558 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.778643 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.778868 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.778970 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.779711 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.780041 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.780314 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.780400 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.780675 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.780772 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.780994 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.781089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.781303 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.781388 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.781617 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.781703 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.781928 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.782013 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.782266 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.782354 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.782579 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.782667 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.782896 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.783020 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.783221 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.783319 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.783531 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.783627 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.783841 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.783934 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.784161 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.784246 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.784468 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.784563 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.784777 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.784869 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.785086 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.785175 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.785396 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.785484 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.785701 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.785793 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.786010 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.786168 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.786338 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.786506 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.786682 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.786832 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.786996 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.787157 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.787333 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.787472 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.787618 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.787790 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.787939 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.788103 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.788247 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.788416 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.788560 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.788738 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.788872 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.789054 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.789169 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.789366 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.789490 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.789681 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.789806 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.789997 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.790113 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.790338 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.790441 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.790656 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.790753 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.790980 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.791066 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.791292 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.791377 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.791612 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.791706 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.791924 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.792018 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.792231 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.792316 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.792544 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.792640 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.792845 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.792929 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.793158 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.793428 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.793538 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.793768 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.794031 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.794120 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.794427 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.794558 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.794855 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.795183 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.795270 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.795524 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.795665 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.795852 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.795997 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.796198 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.796340 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.796510 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.796657 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.796825 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.796991 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.797135 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.797417 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.797517 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.797735 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.797823 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.798046 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.798131 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.798377 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.798467 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.798687 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.798775 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.799000 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.799088 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.799309 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.799403 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.799616 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.799703 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.799922 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.800007 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.800231 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.800319 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.800535 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.800619 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.800842 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.800942 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.801160 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.801467 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.801553 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.801779 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.801914 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.802100 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.802247 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.802445 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.802561 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.802764 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.802871 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.803072 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.803169 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.803403 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.803523 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.803713 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.803815 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.804020 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.804131 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.804327 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.804452 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.804630 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.804798 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.804975 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.805108 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.805281 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.805417 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.805619 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.805745 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.805949 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.806041 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.806317 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.806406 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.806625 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.806724 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.806931 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.807018 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.807255 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.807343 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.807562 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.807656 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.807866 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.807951 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.808170 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.808257 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.808481 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.808568 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.808790 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.808875 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.809093 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.809179 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.809403 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.809489 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.809710 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.809795 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.810017 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.810101 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.810374 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.810472 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.810805 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.810906 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.811114 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.811248 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.811430 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.811559 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.811747 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.811878 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.812054 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.812191 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.812367 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.812501 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.812674 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.812807 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.812994 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.813117 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.813301 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.813436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.813612 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.813723 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.813920 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.814031 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.814250 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.814350 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.814564 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.814662 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.814871 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.814980 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.815196 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.815293 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.815512 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.815610 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.815821 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.815916 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.816126 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.816220 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.816427 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.816523 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.816733 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.816829 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.817039 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.817145 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.817343 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.817445 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.817648 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.817745 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.817958 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.818054 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.818288 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.818399 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.818596 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.818695 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.818903 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.819008 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.819214 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.819320 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.819523 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.819619 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.819826 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.819921 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.820130 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.820235 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.820435 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.820530 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.820739 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.820844 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.821041 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.821145 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.821343 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.821447 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.821644 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.821740 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.821948 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.822045 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.822285 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.822382 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.822592 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.822691 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.822896 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.822986 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.823217 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.823304 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.823528 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.823628 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.823831 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.823931 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.824134 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.824227 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.824438 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.824534 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.824779 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.824868 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.825085 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.825179 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.825398 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.825496 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.825716 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.825803 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.826593 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.826714 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.827034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.827166 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.827357 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.827498 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.827677 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.827820 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.827989 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.828142 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.828299 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.828452 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.828625 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.828771 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.828942 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.829092 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.829364 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.829513 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.829664 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.829803 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.829947 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.830097 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.830258 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.830346 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.830527 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.830636 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.830840 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.830950 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.831156 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.831273 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.831468 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.831598 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.831780 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.831922 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.832099 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.832228 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.832416 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.832537 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.832733 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.832858 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.833050 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.833168 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.833367 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.833462 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.833686 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.833797 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.833999 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.834098 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.834333 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.834437 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.834648 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.834736 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.834956 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.835044 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.835284 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.835380 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.835596 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.835683 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.835904 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.835990 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.836213 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.836310 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.836520 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.836607 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.836837 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.836931 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.837144 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.837245 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.837447 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.837571 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.837766 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.837910 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.838063 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.838210 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.838410 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.838525 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.838716 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.838843 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.839145 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.839233 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.839463 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.839570 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.839774 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.839859 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.840080 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.840166 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.840396 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.840481 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.840712 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.840805 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.841030 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.841127 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.841343 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.841428 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.841886 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.841996 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.842244 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.842547 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.842643 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.842880 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.842967 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.843186 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.843274 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.843495 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.843581 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.843805 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.843908 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.844111 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.844210 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.844424 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.844509 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.844748 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.844832 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.845057 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.845152 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.845363 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.845456 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.845669 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.845765 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.845994 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.846165 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.846325 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.846506 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.846648 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.846819 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.847083 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.847177 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.847412 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.847541 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.847705 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.847801 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.848060 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.848154 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.848376 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.848463 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.848689 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.848786 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.849015 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.849128 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.849337 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.849424 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.849653 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.849755 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.849958 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.850056 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.850289 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.850391 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.850599 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.850684 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.850921 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.851009 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.851237 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.851324 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.851551 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.851636 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.851867 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.851963 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.852173 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.852284 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.852497 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.852591 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.852824 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.852912 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.853138 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.853223 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.853462 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.853555 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.853811 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.853898 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.854138 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.854332 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.854457 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.854555 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.854764 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.854853 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.855088 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.855176 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.855396 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.855497 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.855712 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.855799 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.856019 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.856105 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.856327 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.856427 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.856633 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.856719 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.856940 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.857026 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.857902 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.858020 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.858241 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.858556 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.858701 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.858884 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.858985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.859213 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.859309 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.859538 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.859673 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.859849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.859948 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.860173 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.860273 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.860484 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.860579 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.860795 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.860893 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.861106 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.861193 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.861418 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.861504 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.861741 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.861835 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.862060 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.862145 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.862410 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.862509 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.862727 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.862823 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.863035 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.863122 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.863347 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.863435 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.863654 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.863741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.863997 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.864091 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.864302 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.864388 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.864622 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.864716 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.864952 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.865038 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.865261 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.865347 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.865571 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.865658 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.865886 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.865973 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.866214 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.866317 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.866529 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.866615 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.866838 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.866933 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.867151 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.867247 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.867456 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.867549 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.867762 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.867848 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.868066 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.868163 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.868372 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.868467 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.868678 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.868765 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.868985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.869085 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.869297 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.869384 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.869602 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.869689 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.869907 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.870002 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.870231 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.870320 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.870556 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.870641 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.870861 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.870958 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.871183 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.871269 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.871492 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.871578 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.871799 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.871887 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.872116 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.872203 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.872422 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.872509 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.872746 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.872889 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.873665 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.873772 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.874015 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.874304 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.874512 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.874637 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.874836 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.874966 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.875161 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.875302 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.875482 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.875616 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.875804 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.875942 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.876118 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.876267 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.876439 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.876589 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.876759 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.876910 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.877079 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.877231 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.877550 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.877635 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.877869 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.877963 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.878187 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.878282 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.878522 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.878618 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.878840 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.878935 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.879158 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.879247 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.879476 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.879563 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.879792 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.879996 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.880097 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.880327 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.880417 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.880643 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.880739 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.880957 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.881046 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.881270 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.881359 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.881590 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.881677 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.881905 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.881995 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.882241 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.882334 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.882549 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.882654 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.882868 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.882957 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.883179 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.883274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.883514 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.883616 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.883837 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.883925 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.884162 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.884249 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.884483 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.884628 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.884802 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.884896 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.885120 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.885205 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.885433 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.885527 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.885749 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.885836 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.886069 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.886155 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.886426 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.886515 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.886731 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.886818 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.887044 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.887130 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.887356 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.887450 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.887670 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.887757 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.887985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.888080 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.888297 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.888385 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.888733 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.889220 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.889316 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.889542 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.889632 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.889858 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.889986 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.890177 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.890287 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.890518 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.890779 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.890876 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.891104 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.891192 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.891445 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.891787 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.892030 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.892117 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.892348 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.892434 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.892669 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.892757 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.892992 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.893190 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.893323 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.893512 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.893635 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.893845 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.893933 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.894174 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.894323 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.894523 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.894624 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.894843 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.894946 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.895162 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.895250 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.895491 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.895579 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.895797 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.895892 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.896104 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.896200 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.896415 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.896511 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.896725 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.896951 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.897047 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.897309 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.897407 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.897631 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.897720 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.897942 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.898041 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.898302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.898407 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.898630 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.898716 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.898945 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.899205 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.899300 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.899557 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.899644 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.899874 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.899958 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.900197 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.900307 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.900516 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.900603 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.900826 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.900913 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.901137 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.901234 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.901453 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.901541 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.901767 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.901865 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.902075 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.902176 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.902420 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.902511 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.902728 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.902816 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.903061 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.903149 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.903371 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.903457 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.903681 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.903769 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.903990 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.904107 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.904470 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.904909 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.905008 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.905220 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.905317 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.905534 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.905620 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.905849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.905937 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.906157 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.906306 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.906491 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.906577 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.906800 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.906895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.907109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.907203 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.907417 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.907504 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.907724 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.907810 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.908032 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.908127 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.908345 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.908437 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.908651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.908776 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.908962 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.909050 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.909268 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.909363 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.909584 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.909670 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.909888 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.909983 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.910212 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.910314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.910556 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.910655 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.910876 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.910970 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.911180 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.911272 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.911486 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.911581 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.911803 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.911889 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.912114 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.912360 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.912454 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.912698 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.912786 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.913030 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.913117 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.913368 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.913457 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.913682 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.913768 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.914004 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.914235 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.914337 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.914576 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.914673 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.914899 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.914996 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.915234 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.915320 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.915558 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.915653 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.915951 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.916175 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.916262 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.916484 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.916572 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.916797 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.916891 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.917110 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.917205 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.917425 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.917525 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.917739 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.917842 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.918054 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.918150 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.918396 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.918493 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.918712 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.918801 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.919026 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.919130 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.919339 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.919426 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.919652 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.920312 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.920625 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.920805 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.920953 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.921142 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.921280 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.921465 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.921599 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.921792 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.921916 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.922139 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.922270 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.922494 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.922593 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.922823 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.922909 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.923146 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.923243 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.923472 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.923561 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.923787 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.923873 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.924105 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.924253 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.924418 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.924562 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.924729 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.924886 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.925050 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.925215 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.925381 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.925532 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.925699 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.925860 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.926019 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.926187 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.926464 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.926561 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.926787 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.926875 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.927109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.927205 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.927437 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.927525 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.927752 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.927841 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.928078 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.928174 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.928402 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.928490 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.928718 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.928813 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.929037 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.929179 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.929334 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.929421 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.929648 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.929735 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.929973 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.930061 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.930312 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.930437 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.930625 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.930724 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.930934 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.931024 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.931241 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.931334 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.931594 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.931686 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.931859 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.931946 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.932166 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.932253 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.932474 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.932581 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.932778 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.932864 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.933083 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.933170 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.933391 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.933495 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.933695 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.933781 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.934001 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.934088 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.934331 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.934434 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.934640 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.934773 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.934950 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.935036 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.935253 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.935476 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.935683 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.935956 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.936089 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.936289 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.936429 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.936599 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.936744 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.936913 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.937045 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.937224 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.937364 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.937537 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.937670 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.937845 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.937984 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.938155 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.938319 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.938489 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.938621 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.938796 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.938930 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.939103 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.939249 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.939436 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.939566 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.939756 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.939894 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.940071 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.940217 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.940393 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.940482 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.940709 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.940849 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.941027 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.941164 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.941335 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.941471 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.941648 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.941783 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.941962 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.942100 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.942325 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.942459 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.942595 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.942747 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.942936 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.943070 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.943249 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.943382 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.943566 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.943711 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.943888 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.944020 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.944202 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.944335 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.944515 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.944665 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.944826 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.944958 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.945157 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.945297 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.945476 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.945623 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.945784 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.945916 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.946105 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.946259 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.946448 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.946586 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.946773 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.946911 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.947090 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.947221 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.947408 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.947546 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.947737 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.947831 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.948053 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.948138 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.948365 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.948453 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.948685 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.948773 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.949000 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.949097 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.949316 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.949403 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.949636 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.949723 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.949954 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.950120 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.950304 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.950394 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.950634 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.950720 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.951481 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.951588 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.951829 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:07:13.952002 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.952477 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.952885 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.953241 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.953576 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.953897 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.954238 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.954559 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:07:13.954805 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:07:13.975755 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_db.sqlalchemy.engines [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:13.977888 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:14.039722 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.context [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),164fd8b6-494f-4056-845b-5dc9e7551c56(cell1) {{(pid=103319) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:07:14.041904 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.context [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),164fd8b6-494f-4056-845b-5dc9e7551c56(cell1) {{(pid=103318) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:07:14.044047 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_concurrency.lockutils [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:14.046102 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_concurrency.lockutils [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:14.046764 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:14.047136 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_concurrency.lockutils [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:14.048363 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:14.049145 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:14.050292 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_concurrency.lockutils [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:14.051098 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:14.068025 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:14.069875 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_db.sqlalchemy.engines [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:14.072958 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:14.079327 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_db.sqlalchemy.engines [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:14.232310 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:14.235856 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG oslo_db.sqlalchemy.engines [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:07:14.650763 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:07:14.658284 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:07:14.660152 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: WARNING keystonemiddleware.auth_token [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:07:14.667494 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: WARNING keystonemiddleware.auth_token [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:07:15.010731 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:07:15.017439 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:07:15.019386 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: WARNING keystonemiddleware.auth_token [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:07:15.023530 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d527e469c0 pid: 103318 (default app) May 10 14:07:15.025560 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: WARNING keystonemiddleware.auth_token [None req-58f1a464-948c-45ac-ad23-30ba48c52598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:07:15.025682 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:15.026791 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 May 10 14:07:15.027205 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Tue May 10 14:07:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:15.032257 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d527e469c0 pid: 103319 (default app) May 10 14:08:36.609728 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:36.610775 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 10 14:08:36.611174 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:37.046341 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-4663275d-7cc5-49be-b417-db21a2fd1378 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:37.076843 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-4663275d-7cc5-49be-b417-db21a2fd1378 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.458445 May 10 14:08:37.078883 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 10 14:08:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:39.375014 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:39.375941 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-10c93663-0d7b-4662-9224-f659f9e020a1 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 10 14:08:39.376491 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:39.444457 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-0c6c18a2-7af0-48ca-a490-28025ee7ef02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "disk": 1, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:39.462491 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:08:39.462491 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: warnings.warn(msg) May 10 14:08:39.558060 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-0c6c18a2-7af0-48ca-a490-28025ee7ef02 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.175497 May 10 14:08:39.559002 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:08:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:08:39.780759 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-0a076459-68cb-4175-a0d3-3bd97f5e0021 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:39.783228 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:08:39.783228 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: warnings.warn(msg) May 10 14:08:39.901903 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-0a076459-68cb-4175-a0d3-3bd97f5e0021 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.334993 May 10 14:08:39.902762 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 10 14:08:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:42.218123 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-0c6c18a2-7af0-48ca-a490-28025ee7ef02 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:42.219228 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-0c6c18a2-7af0-48ca-a490-28025ee7ef02 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 10 14:08:42.219644 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:42.328600 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-408c114c-8609-463e-8382-14f605e25c5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "id": "d1"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:42.347488 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:08:42.347488 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: warnings.warn(msg) May 10 14:08:42.483005 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-408c114c-8609-463e-8382-14f605e25c5d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.256081 May 10 14:08:42.483852 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:08:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:08:42.495762 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-9d6adce9-2430-4e8e-9ffb-892a3162d599 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:42.498425 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:08:42.498425 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: warnings.warn(msg) May 10 14:08:42.622931 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-9d6adce9-2430-4e8e-9ffb-892a3162d599 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130712 May 10 14:08:42.623613 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 10 14:08:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:44.928036 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-408c114c-8609-463e-8382-14f605e25c5d admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:44.928989 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-408c114c-8609-463e-8382-14f605e25c5d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 10 14:08:44.929707 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:44.991675 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-e3870639-fa59-41b2-9011-4a1068c99c7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:45.076969 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-e3870639-fa59-41b2-9011-4a1068c99c7b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140809 May 10 14:08:45.077905 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:08:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:08:45.090560 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-289acf2e-49d6-445e-a0d7-158f836090c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:45.160308 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-289acf2e-49d6-445e-a0d7-158f836090c3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073499 May 10 14:08:45.161006 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 10 14:08:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:47.440575 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-e3870639-fa59-41b2-9011-4a1068c99c7b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:47.441590 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-e3870639-fa59-41b2-9011-4a1068c99c7b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 10 14:08:47.442014 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:47.501211 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-38875fa8-ac18-4829-8dc9-7d397b0ec962 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "name": "ds2G", "disk": 10, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:47.582366 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-38875fa8-ac18-4829-8dc9-7d397b0ec962 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134152 May 10 14:08:47.582925 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:08:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:08:47.594559 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-027044b8-8820-44ca-9059-a29c44e9cccf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:47.689531 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-027044b8-8820-44ca-9059-a29c44e9cccf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098572 May 10 14:08:47.690117 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 10 14:08:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:50.007805 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-38875fa8-ac18-4829-8dc9-7d397b0ec962 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:50.009423 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-38875fa8-ac18-4829-8dc9-7d397b0ec962 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 May 10 14:08:50.009907 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:08:50.071524 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-e1486b3b-0b5a-49b3-b6c6-529a358d219a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:50.156308 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-e1486b3b-0b5a-49b3-b6c6-529a358d219a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140366 May 10 14:08:50.157417 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:08:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:08:50.169380 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-703e831b-d921-4f4b-8661-598d4786a1ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:50.280291 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-703e831b-d921-4f4b-8661-598d4786a1ea admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114381 May 10 14:08:50.281018 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 10 14:08:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:52.567212 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-e1486b3b-0b5a-49b3-b6c6-529a358d219a admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:52.568253 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-e1486b3b-0b5a-49b3-b6c6-529a358d219a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 10 14:08:52.568833 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:52.628278 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-9edef4e9-bd5d-44e8-af21-a4e861d47318 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:52.652343 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-9edef4e9-bd5d-44e8-af21-a4e861d47318 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077142 May 10 14:08:52.653092 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 10 14:08:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:08:54.952635 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-e1486b3b-0b5a-49b3-b6c6-529a358d219a admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:54.953650 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-e1486b3b-0b5a-49b3-b6c6-529a358d219a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 10 14:08:54.954056 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:55.015147 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-f193faec-572b-4dc2-b3d8-e6771340a392 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "swap": 0}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:55.102129 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-f193faec-572b-4dc2-b3d8-e6771340a392 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142205 May 10 14:08:55.102751 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:08:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:08:55.114420 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-46771b36-0111-4533-8688-f686e47d1775 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:55.208706 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-46771b36-0111-4533-8688-f686e47d1775 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097853 May 10 14:08:55.209235 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 10 14:08:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:57.773086 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-f193faec-572b-4dc2-b3d8-e6771340a392 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:57.774106 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-f193faec-572b-4dc2-b3d8-e6771340a392 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 10 14:08:57.774610 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:08:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:57.838464 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-94eb5c1d-089a-4646-b001-12999bfc0bb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:57.919758 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-94eb5c1d-089a-4646-b001-12999bfc0bb9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137975 May 10 14:08:57.920318 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:08:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:08:57.934357 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-fe3f897a-0a00-412d-96a6-de59a19faf57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:58.026348 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-fe3f897a-0a00-412d-96a6-de59a19faf57 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095745 May 10 14:08:58.026867 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 10 14:08:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:00.403330 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-94eb5c1d-089a-4646-b001-12999bfc0bb9 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:00.404348 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-94eb5c1d-089a-4646-b001-12999bfc0bb9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 10 14:09:00.404753 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:09:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:00.463598 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-cccd914e-c364-41f0-a5b3-109710f28ebd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "id": "3", "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:00.576116 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-cccd914e-c364-41f0-a5b3-109710f28ebd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.165414 May 10 14:09:00.576711 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:09:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:09:00.588590 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-26f9302a-b071-4a3d-a0ee-a79033548509 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:00.682594 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-26f9302a-b071-4a3d-a0ee-a79033548509 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097617 May 10 14:09:00.683213 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 10 14:09:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:02.953996 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-cccd914e-c364-41f0-a5b3-109710f28ebd admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:02.955033 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-cccd914e-c364-41f0-a5b3-109710f28ebd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 10 14:09:02.955435 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:09:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:03.015240 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-e520160c-0ae9-4a9f-adc6-7a08eb999d15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:03.096698 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-e520160c-0ae9-4a9f-adc6-7a08eb999d15 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134265 May 10 14:09:03.097251 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:09:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:09:03.109875 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-15572e62-2091-4b18-afca-df03cce89f0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:03.202992 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-15572e62-2091-4b18-afca-df03cce89f0c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096610 May 10 14:09:03.203938 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 10 14:09:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:05.561520 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-e520160c-0ae9-4a9f-adc6-7a08eb999d15 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:05.562586 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-e520160c-0ae9-4a9f-adc6-7a08eb999d15 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 10 14:09:05.562987 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:05.628597 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-45cdfa25-3cab-4f90-878a-faf37cb405b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:05.741917 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-45cdfa25-3cab-4f90-878a-faf37cb405b4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.171550 May 10 14:09:05.742752 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 10 14:09:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:09:05.765149 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-63995c6d-70de-4b65-8163-c60d679cd209 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:05.899730 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-63995c6d-70de-4b65-8163-c60d679cd209 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148660 May 10 14:09:05.900513 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 10 14:09:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:29.986287 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-45cdfa25-3cab-4f90-878a-faf37cb405b4 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:29.987245 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-45cdfa25-3cab-4f90-878a-faf37cb405b4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 10 14:09:29.987746 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:30.046224 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-429dc3c2-db6b-4892-a1df-6f45133d35c9 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:30.068907 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-429dc3c2-db6b-4892-a1df-6f45133d35c9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074901 May 10 14:09:30.069461 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 10 14:09:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:09:31.084780 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-45cdfa25-3cab-4f90-878a-faf37cb405b4 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:31.085783 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-45cdfa25-3cab-4f90-878a-faf37cb405b4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 10 14:09:31.086183 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:31.285140 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-32127f34-d01f-41a8-8be4-e4b986d918a1 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:31.290837 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.wsgi [None req-32127f34-d01f-41a8-8be4-e4b986d918a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-32127f34-d01f-41a8-8be4-e4b986d918a1 admin admin] Request method failure captured: May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Accept: application/json May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Accept-Encoding: gzip, deflate May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Connection: keep-alive May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Content-Length: 0 May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Host: 10.222.0.58 May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Openstack-Api-Version: compute 2.90 May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Openstack-System-Scope: None May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: User-Agent: python-novaclient May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Auth-Token: gAAAAABienIbsUXdGxhx4mEZDHXri8Ditkjk9r0qzbozvU1HWRCIjp5aU9OgdP7xKFrQpQx18qEnzFpVF4m74qHRQx9rkS_iK98vHeortM-U-I3_a8GJIoZ5-2pFooalQiNG7d7yhSrubnGOX4GHxqul7GfaU9rrGjiVe7RRSXDC5CCyMbbhQak May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Domain-Id: None May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Domain-Name: None May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Identity-Status: Confirmed May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Is-Admin-Project: True May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Domain-Id: default May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Domain-Name: Default May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Name: admin May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Role: reader,member,admin May 10 14:09:31.294038 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Roles: reader,member,admin May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fab88b77b7fd44528a3ca6841d9f273b"}]}] May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant: admin May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant-Name: admin May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User: admin May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Domain-Id: default May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Domain-Name: Default May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Id: 462840e7ac324edfaa49acd55da38f49 May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Name: admin May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: method: > May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: exception: Flavor 42 could not be found. May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: action_args: {'id': '42'} May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:31.295741 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:31.296735 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:31.298034 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-32127f34-d01f-41a8-8be4-e4b986d918a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:31.299434 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-32127f34-d01f-41a8-8be4-e4b986d918a1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062757 May 10 14:09:31.299434 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 10 14:09:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 14:09:31.306059 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-abd007ea-d68c-4dd9-ad86-fa614c45026a admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:31.328121 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-abd007ea-d68c-4dd9-ad86-fa614c45026a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025709 May 10 14:09:31.328661 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 10 14:09:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:31.338702 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-657cdb7b-486f-4105-a835-42e98c4cc844 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:31.359455 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-657cdb7b-486f-4105-a835-42e98c4cc844 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024469 May 10 14:09:31.359986 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 10 14:09:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:31.369785 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-56d76e1c-ddf5-4229-a789-84bc41c60474 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:31.375272 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.wsgi [None req-56d76e1c-ddf5-4229-a789-84bc41c60474 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-56d76e1c-ddf5-4229-a789-84bc41c60474 admin admin] Request method failure captured: May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Accept: application/json May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Accept-Encoding: gzip, deflate May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Connection: keep-alive May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Content-Length: 0 May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Host: 10.222.0.58 May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Openstack-Api-Version: compute 2.90 May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Openstack-System-Scope: None May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: User-Agent: python-novaclient May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Auth-Token: gAAAAABienIbsUXdGxhx4mEZDHXri8Ditkjk9r0qzbozvU1HWRCIjp5aU9OgdP7xKFrQpQx18qEnzFpVF4m74qHRQx9rkS_iK98vHeortM-U-I3_a8GJIoZ5-2pFooalQiNG7d7yhSrubnGOX4GHxqul7GfaU9rrGjiVe7RRSXDC5CCyMbbhQak May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Domain-Id: None May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Domain-Name: None May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Identity-Status: Confirmed May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Is-Admin-Project: True May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Domain-Id: default May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Domain-Name: Default May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Name: admin May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Role: reader,member,admin May 10 14:09:31.379107 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Roles: reader,member,admin May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fab88b77b7fd44528a3ca6841d9f273b"}]}] May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant: admin May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant-Name: admin May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User: admin May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Domain-Id: default May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Domain-Name: Default May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Id: 462840e7ac324edfaa49acd55da38f49 May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Name: admin May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: method: > May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: exception: Flavor 42 could not be found. May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: action_args: {'id': '42'} May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:31.380672 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:31.381651 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:31.382985 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-56d76e1c-ddf5-4229-a789-84bc41c60474 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:31.384198 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-56d76e1c-ddf5-4229-a789-84bc41c60474 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014508 May 10 14:09:31.384198 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 10 14:09:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:09:32.277910 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-657cdb7b-486f-4105-a835-42e98c4cc844 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:32.278975 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-657cdb7b-486f-4105-a835-42e98c4cc844 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 10 14:09:32.279377 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:32.469603 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-40de97b6-8c6d-47f5-8ca4-1da02cba22e8 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:32.475251 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.wsgi [None req-40de97b6-8c6d-47f5-8ca4-1da02cba22e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-40de97b6-8c6d-47f5-8ca4-1da02cba22e8 admin admin] Request method failure captured: May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Accept: application/json May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Accept-Encoding: gzip, deflate May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Connection: keep-alive May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Content-Length: 0 May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Host: 10.222.0.58 May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Openstack-Api-Version: compute 2.90 May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Openstack-System-Scope: None May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: User-Agent: python-novaclient May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Auth-Token: gAAAAABienIcft525fdXUh-VwUK3ipFsrMJ6Am_Zfmdd9XRyMtlbR5nNGRWZO6w-EynCN_PedDdi764K4nWmYVu2gVV4jCa5CI_OucqOFce0L98gY0WCOlHeBNvM2JkYx7QkjRJ3XTvWnl4TFCLAg_lodkbihmxMRFRJ5M2meiv6lSR1Ouc0TDE May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Domain-Id: None May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Domain-Name: None May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Identity-Status: Confirmed May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Is-Admin-Project: True May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Domain-Id: default May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Domain-Name: Default May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Name: admin May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Role: reader,member,admin May 10 14:09:32.476601 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Roles: reader,member,admin May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fab88b77b7fd44528a3ca6841d9f273b"}]}] May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant: admin May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant-Name: admin May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User: admin May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Domain-Id: default May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Domain-Name: Default May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Id: 462840e7ac324edfaa49acd55da38f49 May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Name: admin May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: method: > May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: exception: Flavor 84 could not be found. May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: action_args: {'id': '84'} May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:32.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:32.479089 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:32.480474 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-40de97b6-8c6d-47f5-8ca4-1da02cba22e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:32.481730 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-40de97b6-8c6d-47f5-8ca4-1da02cba22e8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060142 May 10 14:09:32.481730 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 10 14:09:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:09:32.497830 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-79385403-d723-4e5b-b9d7-af007618fccb admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:32.502067 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-79385403-d723-4e5b-b9d7-af007618fccb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017862 May 10 14:09:32.502628 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 10 14:09:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:32.512813 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-4b96e63d-b503-4c97-87a9-53b854f38664 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:32.527360 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-4b96e63d-b503-4c97-87a9-53b854f38664 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018217 May 10 14:09:32.527889 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 10 14:09:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:09:32.537409 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-901f7c93-bbda-4313-bd47-0304230e3db9 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:32.542830 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.wsgi [None req-901f7c93-bbda-4313-bd47-0304230e3db9 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-901f7c93-bbda-4313-bd47-0304230e3db9 admin admin] Request method failure captured: May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Accept: application/json May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Accept-Encoding: gzip, deflate May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Connection: keep-alive May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Content-Length: 0 May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Host: 10.222.0.58 May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Openstack-Api-Version: compute 2.90 May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Openstack-System-Scope: None May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: User-Agent: python-novaclient May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Auth-Token: gAAAAABienIcft525fdXUh-VwUK3ipFsrMJ6Am_Zfmdd9XRyMtlbR5nNGRWZO6w-EynCN_PedDdi764K4nWmYVu2gVV4jCa5CI_OucqOFce0L98gY0WCOlHeBNvM2JkYx7QkjRJ3XTvWnl4TFCLAg_lodkbihmxMRFRJ5M2meiv6lSR1Ouc0TDE May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Domain-Id: None May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Domain-Name: None May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Identity-Status: Confirmed May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Is-Admin-Project: True May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Domain-Id: default May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Domain-Name: Default May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Name: admin May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Role: reader,member,admin May 10 14:09:32.544314 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Roles: reader,member,admin May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fab88b77b7fd44528a3ca6841d9f273b"}]}] May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant: admin May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant-Name: admin May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User: admin May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Domain-Id: default May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Domain-Name: Default May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Id: 462840e7ac324edfaa49acd55da38f49 May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Name: admin May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: method: > May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: exception: Flavor 84 could not be found. May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: action_args: {'id': '84'} May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:32.545850 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:32.546849 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:32.548274 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-901f7c93-bbda-4313-bd47-0304230e3db9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:32.549548 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-901f7c93-bbda-4313-bd47-0304230e3db9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012278 May 10 14:09:32.549548 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 10 14:09:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 14:09:33.527833 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-4b96e63d-b503-4c97-87a9-53b854f38664 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.528836 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-4b96e63d-b503-4c97-87a9-53b854f38664 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 10 14:09:33.529238 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:33.756533 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-ebe500ad-f4ed-4277-b4aa-39c768debc65 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.763227 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.wsgi [None req-ebe500ad-f4ed-4277-b4aa-39c768debc65 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-ebe500ad-f4ed-4277-b4aa-39c768debc65 admin admin] Request method failure captured: May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Accept: application/json May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Accept-Encoding: gzip, deflate May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Connection: keep-alive May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Content-Length: 0 May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Host: 10.222.0.58 May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Openstack-Api-Version: compute 2.90 May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Openstack-System-Scope: None May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: User-Agent: python-novaclient May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Auth-Token: gAAAAABienIdvZaB8dp9jq5NDrJi507QdptwFup1yTLfGf-lmDVOckPVFWjiE8lUaTFxa2OI6kFSLwA3EaHDo-KHoudSkLxnrlGxkvyNwNIFDeHJZf6lUKNH44a5QVAtulvVfrMcoCEgtjJUwLOvzlnY8J2YBGBTqlAsyuW52o7hFaC0MUz-Swg May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Domain-Id: None May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Domain-Name: None May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Identity-Status: Confirmed May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Is-Admin-Project: True May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Domain-Id: default May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Domain-Name: Default May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Project-Name: admin May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Role: reader,member,admin May 10 14:09:33.765302 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Roles: reader,member,admin May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fab88b77b7fd44528a3ca6841d9f273b"}]}] May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant: admin May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-Tenant-Name: admin May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User: admin May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Domain-Id: default May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Domain-Name: Default May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Id: 462840e7ac324edfaa49acd55da38f49 May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: X-User-Name: admin May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: method: > May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: exception: Flavor 451 could not be found. May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: action_args: {'id': '451'} May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:33.767232 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:33.768692 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: ERROR nova.api.openstack.wsgi May 10 14:09:33.770607 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-ebe500ad-f4ed-4277-b4aa-39c768debc65 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:33.771909 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-ebe500ad-f4ed-4277-b4aa-39c768debc65 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070927 May 10 14:09:33.771909 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:09:33.777971 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-d7721bba-683a-453a-94b9-594493841085 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.797374 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-d7721bba-683a-453a-94b9-594493841085 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023030 May 10 14:09:33.798075 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:33.810173 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.825582 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020793 May 10 14:09:33.826147 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:33.840736 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-fc07fd66-a659-46f4-b915-cf25bdcc26a9 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.848016 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.wsgi [None req-fc07fd66-a659-46f4-b915-cf25bdcc26a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-fc07fd66-a659-46f4-b915-cf25bdcc26a9 admin admin] Request method failure captured: May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Accept: application/json May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Accept-Encoding: gzip, deflate May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Connection: keep-alive May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Content-Length: 0 May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Host: 10.222.0.58 May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Openstack-Api-Version: compute 2.90 May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Openstack-System-Scope: None May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: User-Agent: python-novaclient May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Auth-Token: gAAAAABienIdvZaB8dp9jq5NDrJi507QdptwFup1yTLfGf-lmDVOckPVFWjiE8lUaTFxa2OI6kFSLwA3EaHDo-KHoudSkLxnrlGxkvyNwNIFDeHJZf6lUKNH44a5QVAtulvVfrMcoCEgtjJUwLOvzlnY8J2YBGBTqlAsyuW52o7hFaC0MUz-Swg May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Domain-Id: None May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Domain-Name: None May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Identity-Status: Confirmed May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Is-Admin-Project: True May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Openstack-Nova-Api-Version: 2.90 May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Domain-Id: default May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Domain-Name: Default May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Project-Name: admin May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Role: reader,member,admin May 10 14:09:33.849895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Roles: reader,member,admin May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fab88b77b7fd44528a3ca6841d9f273b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fab88b77b7fd44528a3ca6841d9f273b"}]}] May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant: admin May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant-Id: fab88b77b7fd44528a3ca6841d9f273b May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-Tenant-Name: admin May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User: admin May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Domain-Id: default May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Domain-Name: Default May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Id: 462840e7ac324edfaa49acd55da38f49 May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: X-User-Name: admin May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: method: > May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: exception: Flavor 451 could not be found. May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: action_args: {'id': '451'} May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:33.851526 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:33.852436 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi May 10 14:09:33.853815 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-fc07fd66-a659-46f4-b915-cf25bdcc26a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:33.855064 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-fc07fd66-a659-46f4-b915-cf25bdcc26a9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017258 May 10 14:09:33.855064 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 14:09:34.759035 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:34.760071 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 May 10 14:09:34.760471 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:34.952506 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-b345a733-5b5f-49b5-bc58-51769c00fc43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:35.037170 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-b345a733-5b5f-49b5-bc58-51769c00fc43 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.134662 May 10 14:09:35.037634 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 10 14:09:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:09:35.931923 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:35.932930 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 10 14:09:35.933332 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:36.123640 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-dcd2cec3-2329-40c6-97f1-67b9e6e00b85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:36.239796 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-dcd2cec3-2329-40c6-97f1-67b9e6e00b85 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.168241 May 10 14:09:36.240333 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 10 14:09:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:09:37.143356 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:37.144680 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 May 10 14:09:37.145168 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:37.330116 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-2912c959-0629-46ef-8ae4-707bee5f4bd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:37.431483 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-2912c959-0629-46ef-8ae4-707bee5f4bd5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.151583 May 10 14:09:37.432033 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 10 14:09:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:09:38.346851 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:38.348023 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001779 May 10 14:09:38.348426 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:38.551604 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-52a41b1b-96a4-40a3-831b-494d7f2c3497 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:38.649510 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-52a41b1b-96a4-40a3-831b-494d7f2c3497 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.156995 May 10 14:09:38.650091 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 10 14:09:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:09:39.536446 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:39.537448 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 10 14:09:39.537853 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:09:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:39.731717 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-4620ee33-c388-497d-bb7e-3e56aebb1ae0 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:39.750797 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-4620ee33-c388-497d-bb7e-3e56aebb1ae0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071746 May 10 14:09:39.751273 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Tue May 10 14:09:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:10:43.628731 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:43.629723 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-7580f9ee-da34-4784-9658-f3038e03ae5b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 10 14:10:43.630119 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 10 14:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:10:43.687083 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-c45e4a99-177b-4991-b335-828fa9d4e3c4 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:43.706895 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-c45e4a99-177b-4991-b335-828fa9d4e3c4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070906 May 10 14:10:43.707428 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 10 14:10:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:10:43.730441 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-607ce447-b13e-4df9-baa6-cadfb22557b5 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:43.738889 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-607ce447-b13e-4df9-baa6-cadfb22557b5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012730 May 10 14:10:43.739461 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Tue May 10 14:10:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:43.750721 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-f17441f2-c019-4e8c-9d04-652592e19021 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:43.758240 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-f17441f2-c019-4e8c-9d04-652592e19021 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011129 May 10 14:10:43.758756 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Tue May 10 14:10:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:43.769901 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:43.777339 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011120 May 10 14:10:43.777854 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Tue May 10 14:10:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:10:43.789170 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1dc10ea5-3146-4859-875a-cde6c67c41e7 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:43.796502 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1dc10ea5-3146-4859-875a-cde6c67c41e7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010844 May 10 14:10:43.797012 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Tue May 10 14:10:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:20.834394 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:20.835405 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 May 10 14:14:20.835831 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:14:21.105818 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-2d4470ad-0b03-4425-8bca-96388fd7e50a admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:21.107318 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:14:21.107318 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: warnings.warn(msg) May 10 14:14:21.108577 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-2d4470ad-0b03-4425-8bca-96388fd7e50a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:21.109017 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-2d4470ad-0b03-4425-8bca-96388fd7e50a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:21.109805 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-2d4470ad-0b03-4425-8bca-96388fd7e50a admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:21.110255 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-2d4470ad-0b03-4425-8bca-96388fd7e50a admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:21.143339 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-2d4470ad-0b03-4425-8bca-96388fd7e50a admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150078 May 10 14:14:21.143911 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 10 14:14:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:14:22.063389 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:22.064459 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 May 10 14:14:22.064853 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:14:22.255662 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-56c70a7c-aff5-4f56-9e0a-8fa201cdf072 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:22.256830 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:14:22.256830 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: warnings.warn(msg) May 10 14:14:22.257990 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-56c70a7c-aff5-4f56-9e0a-8fa201cdf072 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:22.258460 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-56c70a7c-aff5-4f56-9e0a-8fa201cdf072 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:22.260097 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-56c70a7c-aff5-4f56-9e0a-8fa201cdf072 admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:22.260662 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-56c70a7c-aff5-4f56-9e0a-8fa201cdf072 admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:22.280963 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-56c70a7c-aff5-4f56-9e0a-8fa201cdf072 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077330 May 10 14:14:22.281521 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 10 14:14:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:14:33.615282 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:33.616272 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 10 14:14:33.616694 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:14:33.806018 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-b42c05ad-d4dd-4c46-8ed3-69976dbfb11a admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:33.807272 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:14:33.807272 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: warnings.warn(msg) May 10 14:14:33.808441 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-b42c05ad-d4dd-4c46-8ed3-69976dbfb11a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:33.808907 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-b42c05ad-d4dd-4c46-8ed3-69976dbfb11a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:33.809710 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-b42c05ad-d4dd-4c46-8ed3-69976dbfb11a admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:33.810137 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-b42c05ad-d4dd-4c46-8ed3-69976dbfb11a admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:33.834581 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-b42c05ad-d4dd-4c46-8ed3-69976dbfb11a admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079017 May 10 14:14:33.835076 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 10 14:14:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:14:34.748822 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: DEBUG nova.api.openstack.wsgi [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] Calling method '>' {{(pid=103319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:34.750528 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: INFO nova.api.openstack.requestlog [None req-04d4b4be-ecc9-4c16-9972-d1233ab25917 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 May 10 14:14:34.750997 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: [pid: 103319|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 10 14:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:14:34.942865 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-53861f36-cb55-4f96-8cd4-953bf4e763b2 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:34.944145 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 14:14:34.944145 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: warnings.warn(msg) May 10 14:14:34.945315 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-53861f36-cb55-4f96-8cd4-953bf4e763b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:34.945857 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-53861f36-cb55-4f96-8cd4-953bf4e763b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:34.946666 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-53861f36-cb55-4f96-8cd4-953bf4e763b2 admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:34.947093 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-53861f36-cb55-4f96-8cd4-953bf4e763b2 admin admin] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:34.969626 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-53861f36-cb55-4f96-8cd4-953bf4e763b2 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077756 May 10 14:14:34.970167 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 10 14:14:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:15:35.537936 dv-cinder-841125-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 14:15:35.538557 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: Tue May 10 14:15:35 2022 - graceful shutdown triggered... May 10 14:15:35.539045 dv-cinder-841125-4-iscsi devstack@n-api.service[103319]: Gracefully killing worker 2 (pid: 103319)... May 10 14:15:35.539452 dv-cinder-841125-4-iscsi devstack@n-api.service[103318]: Gracefully killing worker 1 (pid: 103318)... May 10 14:15:36.539468 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: worker 1 buried after 1 seconds May 10 14:15:36.540160 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: worker 2 buried after 1 seconds May 10 14:15:36.540160 dv-cinder-841125-4-iscsi devstack@n-api.service[103317]: goodbye to uWSGI. May 10 14:15:36.541477 dv-cinder-841125-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 14:15:36.542102 dv-cinder-841125-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 14:15:36.545046 dv-cinder-841125-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 14:15:36.560068 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 14:15:36 2022] *** May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: nodename: dv-cinder-841125-4-iscsi May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: machine: x86_64 May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: clock source: unix May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: pcre jit disabled May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: detected number of CPU cores: 4 May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: current working directory: / May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: detected binary path: /usr/bin/uwsgi-core May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: your processes number limit is 47680 May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: your memory page size is 4096 bytes May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: detected max file descriptor number: 2048 May 10 14:15:36.580778 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: lock engine: pthread robust mutexes May 10 14:15:36.581876 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: thunder lock: enabled May 10 14:15:36.581876 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 14:15:36.581876 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 14:15:36.632524 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: Python main interpreter initialized at 0x5558205709c0 May 10 14:15:36.632524 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: python threads support enabled May 10 14:15:36.632524 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: your server socket listen backlog is limited to 100 connections May 10 14:15:36.632524 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: your mercy for graceful operations on workers is 90 seconds May 10 14:15:36.632988 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: mapped 403077 bytes (393 KB) for 2 cores May 10 14:15:36.632988 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: *** Operational MODE: preforking *** May 10 14:15:36.633215 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: *** uWSGI is running in multiple interpreter mode *** May 10 14:15:36.633215 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: spawned uWSGI master process (pid: 117643) May 10 14:15:36.633435 dv-cinder-841125-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 14:15:36.634565 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: spawned uWSGI worker 1 (pid: 117660, cores: 1) May 10 14:15:36.634565 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: spawned uWSGI worker 2 (pid: 117661, cores: 1) May 10 14:15:36.634565 dv-cinder-841125-4-iscsi devstack@n-api.service[117643]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 14:15:37.872071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:15:37.900812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:15:38.703013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:15:38.703013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: from cryptography.utils import int_from_bytes May 10 14:15:38.704466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:15:38.704466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: from cryptography.utils import int_from_bytes May 10 14:15:38.704857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:15:38.704857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: from cryptography.utils import int_from_bytes May 10 14:15:38.705179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:15:38.705179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: from cryptography.utils import int_from_bytes May 10 14:15:41.244929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:15:41.245513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:15:41.245744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:15:41.246119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:15:41.246409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:15:41.246807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.247427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.247779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.248111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.248451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.248769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.249353 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.250777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.251100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.251555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.252152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.252740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-4-iscsi {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.253255 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.253412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.253955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.254881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.255276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.255623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.255949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.257302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.258136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.258658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.259143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.259668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.260019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.260369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.260694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.261021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.261364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.261690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.262113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-4-iscsi {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.262479 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.262806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.263132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.263630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.264000 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.264325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.264657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.264988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.265306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.266305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.266722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.267101 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.267438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.267793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.268013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.268274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.268952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.269274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.269581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.270021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.270542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.270881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.271212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.271545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.271805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.272070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.272400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.272727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.273045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.273361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.273676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.273995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.274349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.274669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.275244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.275566 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.275893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.276218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.276649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.276933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.277163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.277579 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.277847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.279319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.279716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.280306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.280861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.281483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.282048 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.282662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.283124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.283456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.283798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.284380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.284968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.285428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.285761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.286089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.286464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.286738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:15:41.287321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:15:41.287480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.287480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.287824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:15:41.287974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.288181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:15:41.288181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:15:41.288520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.288663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.288816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.288978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.289146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.289560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.289728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.289872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.290248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.290427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.290571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.290728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.290883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.291033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.291182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.291335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.291476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.291633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.291776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.291925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.292076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.292218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.292376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-4-iscsi {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.292528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.293277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.293441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.293584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.293835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.294002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.294002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.294002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.294431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.294585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.294809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.294977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.295125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.295303 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.295447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.295686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.296003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.296344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.296551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.296756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.296939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.297084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.297376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.297882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.298117 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.298397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.298552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.298702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.298853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.299006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-4-iscsi {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.299166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.299319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.299485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.299890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.300041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.300202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.300524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.300681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.300833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.300982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.301124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.301290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.301432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.301584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.301735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.301886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.302037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.302272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.302508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.302660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.302809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.302951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.302951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.303235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.303391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.303641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.303797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.303939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.304104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.304257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.304552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.304699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.304841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.305097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.305258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.305411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.305671 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.305850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.306026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.306487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.306666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.306666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.306947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.307103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.307247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.307400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.307550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.307700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.307862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.308003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.308143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.308380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.308594 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.308825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.308984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.309133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.309285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.309578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.309752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.310152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.310441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.311007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.311201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.311354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.311497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.311697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.311847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.311995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.312171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.312320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.312320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.312320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.313268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.313420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.313420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.313714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.313865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.314007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.314147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.314800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.314975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.315120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.315268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.315268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.315533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.315683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.315846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.315997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.316147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.316300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.316467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.316845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.316998 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.317147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.317296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.317438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.317438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.317718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.317868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.318026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.318176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.318391 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.318637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.318637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.318935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.319084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.319288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.319521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.319683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.319834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.320232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.320465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.320644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.320644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.321170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.321170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.321523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.321673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.321673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.321937 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.322133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.322352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.322608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.322920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.323091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.323244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.323437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.323586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.323774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.323937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.324109 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.324260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.324428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.324583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.324732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.324883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.325055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.325231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.325382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.325531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.325686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.325829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.325977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.326117 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.326354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.326503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.326668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.327061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.327211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.327731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.327901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.327901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.328860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.329012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.329204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.329442 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.329671 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.329933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.330596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.330770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.331123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.331275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.331417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.331579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.331579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.331994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.332165 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.332165 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.332459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.332610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.332610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.332907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.333058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.333208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.333357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.333357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.333656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.333808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.333808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:15:41.334073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.334231 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.334390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.334589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.334812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.334994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.334994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.335294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.338366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.340365 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.340620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.340620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.341197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.341452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.341697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.341958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.342229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.342496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.342726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.343011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.343011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.343499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.343799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.344045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.344317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.344563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.344835 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.345081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.345313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.345511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.345511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.345985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.346157 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.346340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.346550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.346550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.347024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.347320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.347320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.350337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.350521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.350699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.350872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.351042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.351190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.351335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.351486 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.351651 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.351803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.351956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.352100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.352241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.352382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.352532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.352686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.352838 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.352980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.353131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.353273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.353421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.353587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.353732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.353873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.354014 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.354167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.354371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.354549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.354706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.354849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.354996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.355136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.355307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.355468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.355622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.355766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.355913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.356055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.356295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.356455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.356599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.356741 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.356881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.357030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.357178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.357333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.357487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.357629 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.357770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.357952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.358126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.358927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.359091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.359244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.359503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.359710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.360258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.360428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.360571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.360733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.360922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.361080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.361533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.361712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.361862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.362013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.362164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.362164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.362511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.362655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.362808 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.362957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.363112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.363269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.363492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.363733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.363962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.364114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.364256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.364412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.364554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.364754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.364901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.365042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.365191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.365398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.365556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.365707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.365849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.365997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.366138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.366319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.366471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.366613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.366613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.366613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.367971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.368244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.368396 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.368545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.369115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.369115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.369413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.369566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.369566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.369843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.370013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.370013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.370852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.371048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.371198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.371341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.371341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.371626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.371861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.371861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.372156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.372307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.372307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.372668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.372817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.372966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.373108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.373249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.373456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.373606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.373766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.373766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.374312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.374477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.374631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.374772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.374913 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.375673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.375866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.376021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.376021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.376309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.376452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.376452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.376726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.376882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.377046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.377046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.377323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.377323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.377599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.377753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.377895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.378035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.378175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.378365 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.378518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.378669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.378849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.379397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.379556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.379699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.379699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.379998 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.380155 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.380318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.380828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.380989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.381245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.381392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.381533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.381533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.381533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.381533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.381533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.382956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.383529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.383672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.383827 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.383979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.383979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.383979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.383979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.384513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.384655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.384803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.384952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.385102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.385252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.385427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.385583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.385732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.385879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.386057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.386309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.386521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.386681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.386849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.386998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.387146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.387294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.387456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.387618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.387766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.387913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.388849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.390090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.390274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.390430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.390614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.390614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.391806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.391952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.391952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.392236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.392389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.392389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.392666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.392817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.392817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.393170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.393392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.393636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.393880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.393880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.394441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.394692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.394941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.395293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.395533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.395777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.395777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.396237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.396496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.396496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.396994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.397251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.397251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.397704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.397930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.398137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.398408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.398567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.398711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.398853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.398993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.399159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.399303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.399303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.400323 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.400479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.400725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.400890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.400890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.401191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.401347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.401917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.402092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.402318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.402491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.402651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.402809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.402961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.403123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.403281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.403431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.403431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.403727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.403876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.404034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.404191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.404352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.404508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.404508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.404802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.404999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.405162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.405312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.405466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.405615 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.405772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.405922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.406070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.406287 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.406456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.406616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.406783 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.406934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.407202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.407363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.407522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.407739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.407739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.408246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.408246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.408736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.408981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.409216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.409216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.409216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.409216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.409216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.410467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.410625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.410783 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.410941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.411098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.411258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.411258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.411258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.411258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.412263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.412421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.412569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.412740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.412740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.412740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.412740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.413326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.413485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.413634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.413793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.413962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.414120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.414338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.414562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.414793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.414967 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.415118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.415266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.415413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.415562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.415726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.415885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.416034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.416209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.416370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.416530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.416762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.417028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.417263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.417419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.417578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.417736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.417960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.418115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.418115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.418466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.418640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.418791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.418950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.419108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.419266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.419423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.419599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.419989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.420364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.420571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.420808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.421050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.421311 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.421563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.422881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.422881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.423359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.423619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.423619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.424185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.424454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.424454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.424978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.425238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.425238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.425746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.425928 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.426185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.426409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.426409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.426690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.426926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.427185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.427440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.427714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.427982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.427982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.428407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.428572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.428572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.428864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.429099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.429099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.429606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.429907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.430486 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.430643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.430841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.431110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.431361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.431602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.431842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.432072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.432072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.432530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.433203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.433440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.433683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.433916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.434069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.434282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.434434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.434434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.434715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.434862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.435133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.435283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.435428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.435583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.435726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.435871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.436034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.436178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.436325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.436459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.436609 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.436753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.436915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.437051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.437193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.437335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.437538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.438214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.438214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.438502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.438502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.438778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.438952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.439286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.439474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.439599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.439694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.439788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.439874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.439973 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.440068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.440352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.440692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.440861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.440861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.441136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.441296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.441464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.441620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.441772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.441926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442786 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.442979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.443938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.444930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445773 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.445897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.446930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.447891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.448359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.448578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.448578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.448578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.448920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.449995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.450125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.450297 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.450616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.450616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.450616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.451160 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.451297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.451297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.451297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.451744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.451947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.451947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.452368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.452593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.452593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.452593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.452593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.452593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.452593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.454994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.455211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.455211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.455211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.455841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.456072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.456072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.456072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.456072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.456072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.456072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.456072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.457406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.457546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.457546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.457546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.457546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.458107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.458329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.458329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.458329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.458957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.459305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.459305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.459646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.459776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.459776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.460027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.460211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.460211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.461179 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.461385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.461570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.461703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.461703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.462005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.462275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.462275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.462686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.462894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.463101 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.463291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.463291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.463669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.463897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.464229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.464711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.464911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.465134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.465134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.465521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.465744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.465939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.466131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.466131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.466524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.466724 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.466943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.467141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.467141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.467508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.467706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.467892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.468099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.468099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.468473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.468667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.468934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.469178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.469178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.469568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.469715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.469715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.469934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.470094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.470287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.470419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.470419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.470880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.471422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.471636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.471861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.471861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.472267 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.472405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.472549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.472680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.472818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.472951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.472951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473213 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.473987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.474346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.474507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.474844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.474979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.474979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.475236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.475364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.475501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.475634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.475762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.475900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.475900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.476159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.476354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.476558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.476715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.476715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.476959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.477968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.478263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.478475 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.478701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.478909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.478909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479169 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.479997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.480260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.480399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.480399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.480643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.480781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.480781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.481341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.481785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.481993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.482243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.482243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.482678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.482891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.482891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.483305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.483514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.483731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.483951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.483951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.485353 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.485573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.485573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.486053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.486369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.486369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.486763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.486909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.487146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.487263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.487263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.487263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.487263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.487263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.487805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.488024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.488241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.488524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.488524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.488524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489117 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.489941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.490551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.490797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.491047 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.491343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.491343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.492774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.492978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.493989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.494965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.495674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.495896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.496094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.496094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.496496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.496691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.496691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.496691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.497233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.497438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.497642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.497830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.497830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.497830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.498409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.498409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.498818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.499004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.499210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.499210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.499580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.499723 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.499847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.500051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.500766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.500766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.501092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.501226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.501484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.501745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.501983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.502295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.502444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.502576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.502818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.502950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.503086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.503226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.503226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.503481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.503610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.503746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.503875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.504777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.505027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.505170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.505170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.505540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.505946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.506088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.506240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.506383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.506515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.506645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.506789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.506919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.507068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.507224 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.507419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.507583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.507724 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.507855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.507992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.508121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.508257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.508634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.508945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.509110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.509410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.509822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.510058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.510397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.510570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.510703 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.510830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.511004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.511299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.511458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.511679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.512026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.512366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.512515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.512657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.512657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.513027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.513161 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.513291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.513430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.513588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.513715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.514112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.514629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.515106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.515623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.516192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.516768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.517314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.517599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.517871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.518032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.518280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.518563 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.518906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.519127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.519550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.519765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.519895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.520212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.520332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.520687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.520836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.521327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.521463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.521762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.521914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.522122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.522457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.522662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.523116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.523259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.523695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.523829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.524259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.524401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.524801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.524935 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.525662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.525872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.526333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.526462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.526849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.526960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.527347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.527530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.527706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.527967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.528112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.528333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.528528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.528935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.529079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.529277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.529602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.529743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.529948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.530157 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.530328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.530616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.530747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.530936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.531312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.531561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.531868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.532057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.532289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.532458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.532605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.532911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.533230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.533573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.533844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.534111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.534308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.534485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.534651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.534850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.534850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.535296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.535447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.535623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.535816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.536187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.536726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.536861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.537203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.537326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.537446 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.537559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.537670 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.537781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.537939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.541108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.541272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.541408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.541554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.541699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.541699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.541945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.542247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.542477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.542627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.542874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.543648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.544515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.544515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.544888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.545660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.546180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.547962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.548331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.548679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.549006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.549137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.549328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.549436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.549647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.549789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.549970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.550139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.563443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.563443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.563443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.563443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.563443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.563853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.563933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.564984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.565574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.565574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.565734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.565909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.566915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.567983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568054 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568616 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.568959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569670 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.569977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.570982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571681 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.571937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:15:41.572863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.572863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.573411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.573869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.574339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.574903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.575455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.576003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.576540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.577061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.577593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.578782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.579311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.579827 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.580350 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.580889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.581613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.582054 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.582596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.583119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.583631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.584158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.584743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.585284 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.585812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.586352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.586934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.587460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.588058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.588600 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.589137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.589729 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.591074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.591612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.592100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.592722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.593338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.594719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.595160 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.597825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.597825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.597825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.597825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.598368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:41.598562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.598562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.598562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.598562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.598562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.598562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.599305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.599305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.599305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.599596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.599907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.600242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.600592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.600921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.601246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.601570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.601917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.602236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.602544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.602860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.603293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.603846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.604194 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.604580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.604895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.605331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.605652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.606020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.606380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.606699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.607026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.607354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.607675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.608001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.608317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.608651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.608997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.609456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.609938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.610521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.610845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.613753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.614513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.614513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.614513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.614513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.614859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.615053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.615053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.615053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.615053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.616624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.616624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.616907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.617478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.617478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.617779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.618088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.618460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.618796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.619112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.619438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.619752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.620078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.620390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.620714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.621039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.621362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.621768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.622104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.622459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.622765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.623085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.624821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.624821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.624821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.624821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.624821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.625482 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.625482 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.625844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.626243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.626559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.626877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.627211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.627571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.627839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.628163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.628474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.628788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.629108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.629440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.629757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.630081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.630432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.630761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.631113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.631431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.631892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.632478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.633012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.633554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.633899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:15:41.634137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:15:41.661673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:41.664931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.context [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),164fd8b6-494f-4056-845b-5dc9e7551c56(cell1) {{(pid=117661) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:15:41.673003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:41.673003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:41.673003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:41.674802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:41.687270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:41.689327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:41.739943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.context [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),164fd8b6-494f-4056-845b-5dc9e7551c56(cell1) {{(pid=117660) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:15:41.744432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:41.746041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:41.747127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:41.749108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:41.765081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:41.770452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:41.863229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:41.958999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:15:42.197089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:15:42.204824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:15:42.372708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:15:42.380725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:15:42.554695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:15:42.561451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-8d16c7d6-6e5b-4de1-afc5-90c2a2fe332e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:15:42.567116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558205709c0 pid: 117661 (default app) May 10 14:15:42.746277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:15:42.752942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-cb8b7964-c713-4d04-9a80-c63afc43c991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:15:42.758288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558205709c0 pid: 117660 (default app) May 10 14:16:26.729011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fcd34b18-eede-4fe8-a3fb-cc3aec275894 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Action: 'create', calling method: .version_select at 0x7fef863c9280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-289943143"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:28.157643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fcd34b18-eede-4fe8-a3fb-cc3aec275894 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.850056 May 10 14:16:28.159449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1154 bytes} [Tue May 10 14:16:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2853 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 14:16:28.412608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ec2bb9f-8c51-4207-b165-ebe7178ff648 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef86457f70>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:28.763467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ec2bb9f-8c51-4207-b165-ebe7178ff648 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 200 len: 344 microversion: 2.1 time: 0.585871 May 10 14:16:28.772221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:28 2022] GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 344 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:29.834334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-403b0cda-4d43-46d3-966e-9536bf4fea35 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef86223280>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:29.879389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-403b0cda-4d43-46d3-966e-9536bf4fea35 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 200 len: 344 microversion: 2.1 time: 0.103439 May 10 14:16:29.880620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:29 2022] GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:30.161328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9fad670-7820-48b1-b2ef-0ccd495547af tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef8628e280>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:30.233548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9fad670-7820-48b1-b2ef-0ccd495547af tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3dcd8e5c-8fe9-4320-bf4e-bef0b599c316" status: 200 len: 351 microversion: 2.1 time: 0.078616 May 10 14:16:30.235587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:30 2022] GET /compute/v2.1/os-volumes/3dcd8e5c-8fe9-4320-bf4e-bef0b599c316 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:30.893514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c15efff-570c-4970-a9ef-7ab0970881cb tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef8628e9d0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:31.059916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c15efff-570c-4970-a9ef-7ab0970881cb tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 200 len: 345 microversion: 2.1 time: 0.171206 May 10 14:16:31.069294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:30 2022] GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:16:31.072761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b31afe38-b34f-4f04-b7d2-ad8f0edd4333 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Action: 'create', calling method: .version_select at 0x7fef8628ec10>, body: {"snapshot": {"volume_id": "84bda838-6a0f-46b7-b0b1-3a03a1bda4ea", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-687015915"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:31.189977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-255636699", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "networks": [{"uuid": "05a89fe6-60e7-492f-8619-adac25499fcc"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:31.475761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] validate_networks() for [('05a89fe6-60e7-492f-8619-adac25499fcc', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:16:31.942924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b31afe38-b34f-4f04-b7d2-ad8f0edd4333 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.873908 May 10 14:16:31.943835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 4/6] 10.222.0.58 () {60 vars in 1161 bytes} [Tue May 10 14:16:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:31.954468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-164953fd-49f5-4316-88b8-40d6f13251c6 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef8628ee50>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:32.111142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-164953fd-49f5-4316-88b8-40d6f13251c6 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.161076 May 10 14:16:32.112879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 5/7] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:31 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:32.122679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b6ef26ed-1c93-45d8-ad89-f0640c321185 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef8628edc0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:32.200253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b6ef26ed-1c93-45d8-ad89-f0640c321185 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.081999 May 10 14:16:32.201054 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 6/8] 10.222.0.58 () {58 vars in 1139 bytes} [Tue May 10 14:16:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:16:32.212614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f67e09d4-4d93-4119-b4ba-584e60c6404c tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef86222040>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:32.252380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f67e09d4-4d93-4119-b4ba-584e60c6404c tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.043542 May 10 14:16:32.253263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 7/9] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:32 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:16:32.674241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:16:32.674711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:16:32.675142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:16:32.675596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:16:32.676017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:16:32.707524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:32.707984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:32.708881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:32.709243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:32.769248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Getting quotas for project 6e0f048425c440288655a28aecc12ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:32.783151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Getting quotas for user f00f343268134dea89e0a7070da14508 and project 6e0f048425c440288655a28aecc12ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:32.809616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:16:32.818681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:16:33.107047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a43de450-d6f3-4a9a-b118-7544cc84005c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252492 May 10 14:16:33.107706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 3/10] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:16:33.118815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84355d5f-9c5d-4863-8b23-9e9b5ca47936 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:33.119574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84355d5f-9c5d-4863-8b23-9e9b5ca47936 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:33.223775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-142351a4-1329-4167-ac6f-8ddf45a6b419 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef85920ee0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:33.344633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-142351a4-1329-4167-ac6f-8ddf45a6b419 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/50af4821-57c3-4635-b1a6-a8a303a0d876" status: 200 len: 350 microversion: 2.1 time: 0.126177 May 10 14:16:33.345195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 4/11] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:33 2022] GET /compute/v2.1/os-volumes/50af4821-57c3-4635-b1a6-a8a303a0d876 => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:33.350759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c3b99f1-696e-4d1c-bc2c-9d675d05f4fa tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef85920940>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:33.453620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c3b99f1-696e-4d1c-bc2c-9d675d05f4fa tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.106861 May 10 14:16:33.455666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 5/12] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:33 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:33.825735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84355d5f-9c5d-4863-8b23-9e9b5ca47936 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:33.854346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84355d5f-9c5d-4863-8b23-9e9b5ca47936 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1214 microversion: 2.1 time: 0.738729 May 10 14:16:33.857190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 8/13] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:33 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1214 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:34.471475 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1c537126-5b0b-4c98-b3c3-aa7f5f6c36a4 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef85941310>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:34.556343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1c537126-5b0b-4c98-b3c3-aa7f5f6c36a4 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.093453 May 10 14:16:34.557160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 6/14] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:34 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:34.873307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d26c622-6e77-4207-99ab-7a2618ed0a3d tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:34.874586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0d26c622-6e77-4207-99ab-7a2618ed0a3d tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:35.079923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d26c622-6e77-4207-99ab-7a2618ed0a3d tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:35.100665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d26c622-6e77-4207-99ab-7a2618ed0a3d tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1214 microversion: 2.1 time: 0.231330 May 10 14:16:35.112328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 9/15] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:34 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:35.567968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5b450b3-751e-434a-9834-ef631d9d846a tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef859419d0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:35.626974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5b450b3-751e-434a-9834-ef631d9d846a tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.062791 May 10 14:16:35.627825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 7/16] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:35 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:36.130221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:36.130221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:36.139655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:36.140107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:36.148341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:36.150291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:36.530560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:36.544085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e92b8699-28c3-447d-940f-3f809499ed36 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1218 microversion: 2.1 time: 0.418988 May 10 14:16:36.566522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 10/17] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:36 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1218 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:36.637930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1cf5ce12-e8a2-46a4-bfbc-14c393d1c797 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef85920d30>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:36.693649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1cf5ce12-e8a2-46a4-bfbc-14c393d1c797 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.059463 May 10 14:16:36.698538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 8/18] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:36 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:37.560863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:37.562271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:37.570907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:37.576106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:37.579964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:37.588540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:37.725980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3408e08c-41d1-4b18-95a3-1e051c7d28f5 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef85941c10>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:37.764949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3408e08c-41d1-4b18-95a3-1e051c7d28f5 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.063596 May 10 14:16:37.765761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 9/19] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:37 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:16:37.802508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:37.820115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a8140117-b789-4da9-8466-eedcb049f7d1 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1218 microversion: 2.1 time: 0.258053 May 10 14:16:37.821661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 11/20] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:37 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1218 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:38.256653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-090b4c8c-a507-47da-91cb-743eaa605b99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Action: 'create', calling method: .version_select at 0x7fef85941550>, body: {"keypair": {"name": "tempest-keypair-1706248831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnpE6k0aiJRMyPKFMO+m/51mwicJk4IfqIqIZX8WdbRbRI6WSIqtnpj/uSrqVViTKrRt5UC+Cd3VVVnS/W+PjFJkesQJnXV1p0VOC98YoT8ZdNvZnKzpoV9GH+ObXgIfg=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:38.307162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-090b4c8c-a507-47da-91cb-743eaa605b99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:38.314963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-090b4c8c-a507-47da-91cb-743eaa605b99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for user 9dae4d7a57f343c8bb7b92dbebea181d and project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:38.450554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-090b4c8c-a507-47da-91cb-743eaa605b99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.298163 May 10 14:16:38.452248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 10/21] 10.222.0.58 () {62 vars in 1199 bytes} [Tue May 10 14:16:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 300 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 14:16:38.749918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2b4007d-9170-4ac4-89d0-a3f0b2839ada tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef86164670>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:38.781522 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-500c3817-b1b0-4896-ae7e-dec2b0120c65 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef859463a0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:38.863398 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2b4007d-9170-4ac4-89d0-a3f0b2839ada tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/31608d89-5e78-4dc3-af1a-c286f2e82614" status: 200 len: 350 microversion: 2.1 time: 0.124417 May 10 14:16:38.864324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-500c3817-b1b0-4896-ae7e-dec2b0120c65 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 287 microversion: 2.1 time: 0.090182 May 10 14:16:38.872914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 11/22] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:38 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:38.872914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:38.873165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 12/23] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:38 2022] GET /compute/v2.1/os-volumes/31608d89-5e78-4dc3-af1a-c286f2e82614 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:38.873257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:38.877727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc8876fd-b77b-4c3a-a413-3c3a4d4c23b0 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef8616c3a0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:38.905568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:38.907929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:38.911887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:38.912452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:39.099493 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc8876fd-b77b-4c3a-a413-3c3a4d4c23b0 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.227367 May 10 14:16:39.112126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 13/24] 10.222.0.58 () {58 vars in 1133 bytes} [Tue May 10 14:16:38 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:39.118956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e1f2595-d47b-47dc-b207-5fc1572f37af tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef861768b0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:39.325178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e1f2595-d47b-47dc-b207-5fc1572f37af tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 202 len: 0 microversion: 2.1 time: 0.211553 May 10 14:16:39.330827 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 14/25] 10.222.0.58 () {58 vars in 1253 bytes} [Tue May 10 14:16:39 2022] DELETE /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:16:39.344775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22afb7e6-17bf-48f1-a271-9d8b848c027c tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef8616cc10>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:39.576464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:39.576888 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22afb7e6-17bf-48f1-a271-9d8b848c027c tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.243382 May 10 14:16:39.577473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 15/26] 10.222.0.58 () {58 vars in 1148 bytes} [Tue May 10 14:16:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:39.597320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd99259e-7b3c-4706-ac16-0722bb00e4d6 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef86222310>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:39.602817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-39322052-205c-4cab-a97c-db7803f59eb0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1266 microversion: 2.1 time: 0.736439 May 10 14:16:39.603761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 12/27] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:38 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1266 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:39.608779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-671ee08b-1383-4b92-b4c7-7eb73ac605c1 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef8488fb80>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:39.749654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd99259e-7b3c-4706-ac16-0722bb00e4d6 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 200 len: 286 microversion: 2.1 time: 0.170597 May 10 14:16:39.750388 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 16/28] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:39 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:39.915439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-671ee08b-1383-4b92-b4c7-7eb73ac605c1 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.310414 May 10 14:16:39.916637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 13/29] 10.222.0.58 () {58 vars in 1133 bytes} [Tue May 10 14:16:39 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:39.929235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c2d9abd-ee0e-49b5-a026-bd3f3193ddcd tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef86164670>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:40.127924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c2d9abd-ee0e-49b5-a026-bd3f3193ddcd tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.202545 May 10 14:16:40.128507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 17/30] 10.222.0.58 () {58 vars in 1166 bytes} [Tue May 10 14:16:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:40.148485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-33af9fb5-fed1-477b-9fb2-88f619801160 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef86bf8790>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:40.531019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-33af9fb5-fed1-477b-9fb2-88f619801160 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.394092 May 10 14:16:40.531933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 14/31] 10.222.0.58 () {58 vars in 1169 bytes} [Tue May 10 14:16:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:40.545262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9086a356-c8e4-4f3b-a2c1-14f326255982 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef8482dc10>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:40.858804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9086a356-c8e4-4f3b-a2c1-14f326255982 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.317961 May 10 14:16:40.860864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 15/32] 10.222.0.58 () {58 vars in 1154 bytes} [Tue May 10 14:16:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:16:40.871657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:40.872552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:40.921110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-920fbd2d-7e52-462d-9186-1a3a0b42584b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Action: 'create', calling method: .version_select at 0x7fef86164310>, body: {"keypair": {"name": "tempest-keypair-1019273056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEpxErMDjrBm8uJBe/IhbP9k5xWurc+GRl/59h5f2+jUuo7YhxHjmOhXpSjRCDdS9Njn/cxsSIY8b20ddt3Lox8+mw6y0hj1CmWWbgMzSivnZNfgFFteGSzyRKtORuVkQ=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:40.926856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:40.927553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:40.928249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:40.928693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:41.086081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-920fbd2d-7e52-462d-9186-1a3a0b42584b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:41.096759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-920fbd2d-7e52-462d-9186-1a3a0b42584b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for user ecb4c97543e1452d8e6c8f1564addc76 and project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:41.108988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:41.127465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9587cc8-3896-4884-ab67-04c62df565d9 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1272 microversion: 2.1 time: 0.265287 May 10 14:16:41.128089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 16/33] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:40 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:41.143414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb3a8bfd-7df3-4890-911d-c69c01144b94 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef8482d9d0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:41.213981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-eb3a8bfd-7df3-4890-911d-c69c01144b94 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] HTTP exception thrown: Snapshot 3841c654-0266-47c0-9991-f00a6b529147 could not be found. May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb3a8bfd-7df3-4890-911d-c69c01144b94 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Request method failure captured: May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 HTTP/1.1 May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienO5OR-SyrKkVcJFEM-zyaeyp_mhYO9maDrdW1aBPNC6IqMtfpMj8bl5A_-CB01LAZRGTR66bfAvnH6MQtxoBLuwFZ7s01awSx9Ko7IFeVZlYZiNE0U55R3ImYOh4QESiWZV5c7OJzUz88dS9Rn6egm6VnCcRdW-30_iIoNui9HaVTc May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:16:41.219454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1873a08af77f4a998cf5019df662c2f2"}]}] May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 0fc0746bf323456394119f58a2ad28fa May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Snapshot 3841c654-0266-47c0-9991-f00a6b529147 could not be found. May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '3841c654-0266-47c0-9991-f00a6b529147'} May 10 14:16:41.221018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3841c654-0266-47c0-9991-f00a6b529147 could not be found. (HTTP 404) (Request-ID: req-b9ffa099-afa7-4e20-9af3-48089938463b) May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:41.222290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:16:41.223483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3841c654-0266-47c0-9991-f00a6b529147 could not be found. May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 14:16:41.224641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3841c654-0266-47c0-9991-f00a6b529147 could not be found. May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3841c654-0266-47c0-9991-f00a6b529147 could not be found. May 10 14:16:41.225778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:41.227622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb3a8bfd-7df3-4890-911d-c69c01144b94 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Returning 404 to user: Snapshot 3841c654-0266-47c0-9991-f00a6b529147 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:41.228868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb3a8bfd-7df3-4890-911d-c69c01144b94 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147" status: 404 len: 111 microversion: 2.1 time: 0.098635 May 10 14:16:41.230006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 17/34] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 10 14:16:41 2022] GET /compute/v2.1/os-snapshots/3841c654-0266-47c0-9991-f00a6b529147 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:16:41.248949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e9670c4-1195-40d8-b167-b5c339068718 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef86230160>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:41.269070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-920fbd2d-7e52-462d-9186-1a3a0b42584b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.788401 May 10 14:16:41.277067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 18/35] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:16:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:16:41.284584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92932eda-402a-45da-a157-5ec755106d31 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef86106700>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:41.573585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e9670c4-1195-40d8-b167-b5c339068718 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.339580 May 10 14:16:41.573585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 18/36] 10.222.0.58 () {58 vars in 1187 bytes} [Tue May 10 14:16:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:41.589995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-65173e3a-1840-4220-97d6-f41ec94325d7 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] Calling method '.version_select at 0x7fef84849ee0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:41.679142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92932eda-402a-45da-a157-5ec755106d31 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 202 len: 0 microversion: 2.1 time: 0.396385 May 10 14:16:41.679142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 19/37] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:16:41 2022] DELETE /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:16:41.689063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ae5b62dc-8b2d-45a6-91ad-ea7717ac441b tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef860f7ca0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:41.935380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ae5b62dc-8b2d-45a6-91ad-ea7717ac441b tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 200 len: 344 microversion: 2.1 time: 0.250134 May 10 14:16:41.936876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 20/38] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:41 2022] GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 344 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:41.979270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-65173e3a-1840-4220-97d6-f41ec94325d7 tempest-VolumesTestJSON-676367636 tempest-VolumesTestJSON-676367636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.393264 May 10 14:16:41.985625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 19/39] 10.222.0.58 () {58 vars in 1154 bytes} [Tue May 10 14:16:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:42.150454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:42.151381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:42.169461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:42.170110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:42.171386 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:42.174882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:42.559464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:42.573769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2045900e-b8b1-4e6e-96a7-1954f3175558 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1272 microversion: 2.1 time: 0.432079 May 10 14:16:42.582957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 21/40] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:42 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:42.952181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16b7fbe9-3344-4c99-9bc3-577b7482e7c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef847d7430>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:43.022700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-16b7fbe9-3344-4c99-9bc3-577b7482e7c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] HTTP exception thrown: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16b7fbe9-3344-4c99-9bc3-577b7482e7c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Request method failure captured: May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea HTTP/1.1 May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienO5OR-SyrKkVcJFEM-zyaeyp_mhYO9maDrdW1aBPNC6IqMtfpMj8bl5A_-CB01LAZRGTR66bfAvnH6MQtxoBLuwFZ7s01awSx9Ko7IFeVZlYZiNE0U55R3ImYOh4QESiWZV5c7OJzUz88dS9Rn6egm6VnCcRdW-30_iIoNui9HaVTc May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:16:43.026191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1873a08af77f4a998cf5019df662c2f2"}]}] May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 0fc0746bf323456394119f58a2ad28fa May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '84bda838-6a0f-46b7-b0b1-3a03a1bda4ea'} May 10 14:16:43.027375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. (HTTP 404) (Request-ID: req-d654ddd4-d6bd-4071-b462-51cd3b246a5c) May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.028032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:16:43.029197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:16:43.030032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.031001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16b7fbe9-3344-4c99-9bc3-577b7482e7c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Returning 404 to user: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:43.032073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-16b7fbe9-3344-4c99-9bc3-577b7482e7c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 404 len: 109 microversion: 2.1 time: 0.084051 May 10 14:16:43.032817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 20/41] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:42 2022] GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:16:43.050553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-881491c8-44cc-4cb7-ada2-7656bc653264 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef858b6ca0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:43.205886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-881491c8-44cc-4cb7-ada2-7656bc653264 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] HTTP exception thrown: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-881491c8-44cc-4cb7-ada2-7656bc653264 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Request method failure captured: May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea HTTP/1.1 May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienO5OR-SyrKkVcJFEM-zyaeyp_mhYO9maDrdW1aBPNC6IqMtfpMj8bl5A_-CB01LAZRGTR66bfAvnH6MQtxoBLuwFZ7s01awSx9Ko7IFeVZlYZiNE0U55R3ImYOh4QESiWZV5c7OJzUz88dS9Rn6egm6VnCcRdW-30_iIoNui9HaVTc May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:16:43.210575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1873a08af77f4a998cf5019df662c2f2"}]}] May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 0fc0746bf323456394119f58a2ad28fa May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '84bda838-6a0f-46b7-b0b1-3a03a1bda4ea'} May 10 14:16:43.214877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. (HTTP 404) (Request-ID: req-d00f5de6-71a0-4360-8653-7a5c7340e3c8) May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.215508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:16:43.217747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 14:16:43.220204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-881491c8-44cc-4cb7-ada2-7656bc653264 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Returning 404 to user: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-881491c8-44cc-4cb7-ada2-7656bc653264 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 404 len: 109 microversion: 2.1 time: 0.169445 May 10 14:16:43.222825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 22/42] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:16:43 2022] DELETE /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:16:43.225813 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ddccb75-6598-4f30-bb42-b48b321c45c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Calling method '.version_select at 0x7fef84849160>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:43.304859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-7ddccb75-6598-4f30-bb42-b48b321c45c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] HTTP exception thrown: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ddccb75-6598-4f30-bb42-b48b321c45c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Request method failure captured: May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea HTTP/1.1 May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienO5OR-SyrKkVcJFEM-zyaeyp_mhYO9maDrdW1aBPNC6IqMtfpMj8bl5A_-CB01LAZRGTR66bfAvnH6MQtxoBLuwFZ7s01awSx9Ko7IFeVZlYZiNE0U55R3ImYOh4QESiWZV5c7OJzUz88dS9Rn6egm6VnCcRdW-30_iIoNui9HaVTc May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:16:43.305235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1873a08af77f4a998cf5019df662c2f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1873a08af77f4a998cf5019df662c2f2"}]}] May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 1873a08af77f4a998cf5019df662c2f2 May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1700825389 May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 0fc0746bf323456394119f58a2ad28fa May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1700825389-project May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '84bda838-6a0f-46b7-b0b1-3a03a1bda4ea'} May 10 14:16:43.306219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. (HTTP 404) (Request-ID: req-a7f90176-c788-41d6-b881-1543254644eb) May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.307315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:16:43.308191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:16:43.310516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ddccb75-6598-4f30-bb42-b48b321c45c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] Returning 404 to user: Volume 84bda838-6a0f-46b7-b0b1-3a03a1bda4ea could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ddccb75-6598-4f30-bb42-b48b321c45c2 tempest-VolumesSnapshotsTestJSON-1700825389 tempest-VolumesSnapshotsTestJSON-1700825389-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea" status: 404 len: 109 microversion: 2.1 time: 0.086844 May 10 14:16:43.313938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 21/43] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:16:43 2022] GET /compute/v2.1/os-volumes/84bda838-6a0f-46b7-b0b1-3a03a1bda4ea => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:16:43.610806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:43.611847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:43.621900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:43.621900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:43.627267 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:43.627764 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:43.948396 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:43.962585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c700b82f-cd09-446f-860b-e341fb501034 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1272 microversion: 2.1 time: 0.359395 May 10 14:16:43.966011 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 23/44] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:43 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:44.991030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:44.995663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:45.012787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:45.016042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:45.018709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:45.021452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:45.566484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-531355925", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:45.730045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] validate_networks() for [('76e2bc11-fa39-4fbb-bbfd-3797d10be68b', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:16:46.691113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:46.703076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e1fb11c-0b9b-4e5b-aec0-73454c7a7160 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 1.723276 May 10 14:16:46.704006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 24/45] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:44 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:47.722779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:47.724335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:47.743119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:47.751270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:47.751270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:47.751270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:49.021750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:49.034294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-53736ce0-6181-4561-8666-760339b0482e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 1.317620 May 10 14:16:49.040857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 25/46] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:47 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:49.987803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a74c3bf-7b56-4351-a41e-002e03a43139 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'create', calling method: .version_select at 0x7fef8583a790>, body: {"keypair": {"name": "tempest-keypair-632850092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD91DTaTRhNYoNZhSipxANppObnFh2VGhe9US+m9Iebqm4b7fdpUnX3ToI3GZkOJnf4uM3DK36jQLFExzLjqFwqF+P4y3QB4MzQcmv6ucL/rD/ilIXRsVsSzJgqsfbqTnA=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:50.074917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-7a74c3bf-7b56-4351-a41e-002e03a43139 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:50.112767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-7a74c3bf-7b56-4351-a41e-002e03a43139 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for user 8d788b9560504c3795dbb623f10467cd and project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:50.231496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a74c3bf-7b56-4351-a41e-002e03a43139 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.188660 May 10 14:16:50.232764 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 26/47] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:16:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:50.252593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:50.253271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:50.273543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:50.273999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:50.274821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:50.275263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:50.328433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:16:50.328433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:16:50.328433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:16:50.331334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:16:50.332243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:16:50.377391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:50.379773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:50.382381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:50.392741 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:50.509735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:50.517313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for user 5e3edc87e7014d8598ba8c9517b81cf7 and project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:50.536361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:16:50.540612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:16:50.822780 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc7fab81-c424-48f1-af60-59589a88abed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.029240 May 10 14:16:50.826430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 22/48] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:16:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 6034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:16:50.842746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bf24a029-7596-4034-a932-e64a4de57875 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:50.847228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bf24a029-7596-4034-a932-e64a4de57875 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:51.069062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bf24a029-7596-4034-a932-e64a4de57875 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:51.100740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bf24a029-7596-4034-a932-e64a4de57875 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1221 microversion: 2.1 time: 0.265861 May 10 14:16:51.107840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 23/49] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:50 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1221 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:51.225837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:51.235553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b013dac8-b538-46d8-ae6b-72c3a7904483 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 1.001631 May 10 14:16:51.239938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 27/50] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:50 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:51.430028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-78536097", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:51.611902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] validate_networks() for [('76e2bc11-fa39-4fbb-bbfd-3797d10be68b', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:16:52.256687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:52.258327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:52.281192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.282629 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.284369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.285017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.836858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:16:52.837350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:16:52.837834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:16:52.838488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:16:52.839117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:16:52.858837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.859568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.862257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.862870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.934122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:52.942897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-570a0661-763e-47ec-ac56-94537d6208ff tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.690157 May 10 14:16:52.944937 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 28/51] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:52 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:52.951367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-482118313", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e3b58d-1cf0-42df-b72b-500ddf896ce1"}], "security_groups": [{"name": "tempest-securitygroup--1950216149"}], "key_name": "tempest-keypair-1706248831", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:52.966792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:52.978828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for user 5e3edc87e7014d8598ba8c9517b81cf7 and project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:53.013068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:16:53.021798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:16:53.200410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc6ef9b8-26ff-4b5b-be00-da74cbb7136e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.778121 May 10 14:16:53.202564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 24/52] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:16:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:16:53.214225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2a046183-6ac1-4325-a7cd-70f506977644 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:53.217608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2a046183-6ac1-4325-a7cd-70f506977644 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:53.324253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] validate_networks() for [('d4e3b58d-1cf0-42df-b72b-500ddf896ce1', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:16:53.478666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a046183-6ac1-4325-a7cd-70f506977644 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:53.508286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2a046183-6ac1-4325-a7cd-70f506977644 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1220 microversion: 2.1 time: 0.296591 May 10 14:16:53.509646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 25/53] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:53 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1220 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:53.968480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-4b5e63db-2332-440a-b732-e4213725706a req-2ac1753d-f656-46cb-8224-eea660823789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dfc192-c4f0-4f6b-8b06-70c5d807b5eb", "tag": "8109ea46-9ac9-42cd-bd4b-19706888d99e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:54.006405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4b5e63db-2332-440a-b732-e4213725706a req-2ac1753d-f656-46cb-8224-eea660823789 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:54.006405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4b5e63db-2332-440a-b732-e4213725706a req-2ac1753d-f656-46cb-8224-eea660823789 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:54.070690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-4b5e63db-2332-440a-b732-e4213725706a req-2ac1753d-f656-46cb-8224-eea660823789 service nova] Creating event network-changed:8109ea46-9ac9-42cd-bd4b-19706888d99e for instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb on hv-cinder-84112 May 10 14:16:54.071254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4b5e63db-2332-440a-b732-e4213725706a req-2ac1753d-f656-46cb-8224-eea660823789 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 14:16:54.077161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7975b565-c8a9-4128-867c-549a4ae98b3b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:54.081242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7975b565-c8a9-4128-867c-549a4ae98b3b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:54.082417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7975b565-c8a9-4128-867c-549a4ae98b3b None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:54.083551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7975b565-c8a9-4128-867c-549a4ae98b3b None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:54.112969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.compute.rpcapi [None req-7975b565-c8a9-4128-867c-549a4ae98b3b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 14:16:54.115546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7975b565-c8a9-4128-867c-549a4ae98b3b None None] Releasing lock "compute-rpcapi-router" {{(pid=117661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 14:16:54.150667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7975b565-c8a9-4128-867c-549a4ae98b3b None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.638944 May 10 14:16:54.151700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 26/54] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:54.159160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:54.161589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:54.169324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:54.170033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:54.171309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:54.172049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:54.501774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:54.513872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4cf99dfb-9f81-461c-b062-cc8d0d244ab5 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.360742 May 10 14:16:54.537674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 27/55] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:54 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:54.552584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-19375f80-3ac7-440b-b101-be8379423ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:54.553504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-19375f80-3ac7-440b-b101-be8379423ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:54.666596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19375f80-3ac7-440b-b101-be8379423ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:54.682796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-19375f80-3ac7-440b-b101-be8379423ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1220 microversion: 2.1 time: 0.135635 May 10 14:16:54.682796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 28/56] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:54 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:55.147537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-960357005", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e5ec3c3-4d17-4222-ba80-44b733b6bca6"}], "security_groups": [{"name": "tempest-securitygroup--1494816479"}], "key_name": "tempest-keypair-1019273056", "user_data": "}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:55.530665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] validate_networks() for [('3e5ec3c3-4d17-4222-ba80-44b733b6bca6', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:16:56.264728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:16:56.265273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:16:56.265809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:16:56.268228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:16:56.269065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:16:56.310451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.310451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:56.310451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.310451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:56.421199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:56.433713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for user 9dae4d7a57f343c8bb7b92dbebea181d and project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:56.499938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:16:56.516675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:16:56.781223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6b48d099-f944-41c4-b26d-1383fda95db0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.835046 May 10 14:16:56.789112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 29/57] 10.222.0.58 () {62 vars in 1187 bytes} [Tue May 10 14:16:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 14:16:56.794583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:56.802045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:56.818673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.819459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:56.823198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.832878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:57.311620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:16:57.311620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:16:57.311620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:16:57.312300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:16:57.312417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:16:57.332815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:57.336057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:57.337151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:57.337823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:57.377733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:57.389263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:57.398795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-792e45b0-b313-4a1f-ad1c-94cfee03d0ad tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.608226 May 10 14:16:57.401801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for user ecb4c97543e1452d8e6c8f1564addc76 and project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:57.403007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 30/58] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:56 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:57.431551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:57.455052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:57.483989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:16:57.486889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:57.487473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:57.493493 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:57.493975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:57.499405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:16:57.635828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:57.655894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a795d2eb-b90c-49b7-8cf5-b95d59b0f0ea tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1280 microversion: 2.1 time: 0.251491 May 10 14:16:57.661783 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 31/59] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:57 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:57.676015 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd2e945f-5eba-451e-beca-619021081b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:57.676635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd2e945f-5eba-451e-beca-619021081b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:57.784019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd2e945f-5eba-451e-beca-619021081b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:57.798308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd2e945f-5eba-451e-beca-619021081b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:57.798308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd2e945f-5eba-451e-beca-619021081b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:57.799790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd2e945f-5eba-451e-beca-619021081b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1281 microversion: 2.20 time: 0.136777 May 10 14:16:57.800831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 32/60] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:16:57 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:16:58.000463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4998dcd1-0f02-4c5d-baea-a244a6f07db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.846962 May 10 14:16:58.004498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 29/61] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:16:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:16:58.015064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e4f5d89-b581-4593-ba18-71a6a67d0e57 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:58.015936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e4f5d89-b581-4593-ba18-71a6a67d0e57 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:58.159709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e4f5d89-b581-4593-ba18-71a6a67d0e57 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:58.171864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e4f5d89-b581-4593-ba18-71a6a67d0e57 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1241 microversion: 2.1 time: 0.161011 May 10 14:16:58.182817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 33/62] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:58 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:58.424048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:58.424889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:58.453430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:58.455623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:58.460399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:58.462453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:58.679910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:58.681142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:58.694734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:58.705636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:58.713201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:58.714877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:58.827023 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:58.838580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a8cf3f20-1240-4671-aca5-37bcec209b22 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1278 microversion: 2.1 time: 0.162733 May 10 14:16:58.839205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 34/63] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:58 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:58.854338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:58.854938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:58.864954 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:58.871082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:58.871082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:58.871082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:58.983633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:59.007575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-56ced158-d3ad-4655-8ad4-b678a5389de8 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.590540 May 10 14:16:59.008417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 30/64] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:58 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:59.034534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:59.049940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:59.051757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:59.052635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78b17bbe-5857-419e-93a0-c2af1820bd0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1285 microversion: 2.20 time: 0.210368 May 10 14:16:59.053334 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 35/65] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:16:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:16:59.196706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5614147e-24e9-4fb9-b1ce-f9b06fc052ac tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:59.197509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5614147e-24e9-4fb9-b1ce-f9b06fc052ac tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:59.310993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5614147e-24e9-4fb9-b1ce-f9b06fc052ac tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:59.316733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5614147e-24e9-4fb9-b1ce-f9b06fc052ac tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1241 microversion: 2.1 time: 0.123778 May 10 14:16:59.328354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 31/66] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:59 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1241 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:59.835743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1360894684", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cad3622-a51c-4f86-9546-02c91d6a6cf7"}], "security_groups": [{"name": "tempest-securitygroup--1004668498"}], "key_name": "tempest-keypair-632850092", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:59.856900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:59.857834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:59.877943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:59.887341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:59.891671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:59.892541 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:00.111991 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:00.123225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-486f7256-3b06-4644-94ff-086dc24cf2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1278 microversion: 2.1 time: 0.271209 May 10 14:17:00.130405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 32/67] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:16:59 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:00.139563 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:00.141254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:00.149249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:00.150490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:00.151291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:00.151791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:00.203809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] validate_networks() for [('9cad3622-a51c-4f86-9546-02c91d6a6cf7', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:17:00.473965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:00.485977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e53ad6fa-7332-4062-87cf-34cbd77fe235 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.359675 May 10 14:17:00.500663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 33/68] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:00 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:00.519794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:00.520418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:00.533677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:00.535145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:00.535145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:00.535367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:00.656212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:00.670547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:00.670547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:00.670547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ad6c0a6d-9d32-4896-be7f-c9ef6b92771d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1285 microversion: 2.20 time: 0.171026 May 10 14:17:00.670764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 34/69] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:00 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:00.674807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:00.675570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:00.682502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:00.683135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:00.684259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:00.684986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:00.771982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:00.784835 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2a95f99b-a436-41c7-8758-0ab2a288a054 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1237 microversion: 2.1 time: 0.114290 May 10 14:17:00.785744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 35/70] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:00 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:01.044454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:17:01.045251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:17:01.045741 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:17:01.046162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:17:01.046754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:17:01.065150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.070405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.071611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.072251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.098734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:17:01.103711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for user 8d788b9560504c3795dbb623f10467cd and project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:17:01.116828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:17:01.119408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:17:01.143343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:01.145217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:01.158307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.159121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.160146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.161655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.277635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62de871c-7b88-48b2-8465-f60725d7c070 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.448902 May 10 14:17:01.285925 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 36/71] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:16:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:17:01.298824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-43b30c3d-2abd-43e6-bdec-a63dba755f59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:01.299450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-43b30c3d-2abd-43e6-bdec-a63dba755f59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:01.444756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-43b30c3d-2abd-43e6-bdec-a63dba755f59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:01.459413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-43b30c3d-2abd-43e6-bdec-a63dba755f59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1237 microversion: 2.1 time: 0.171951 May 10 14:17:01.463872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 37/72] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1237 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:01.508669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:01.509356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:01.520497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.524072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.524072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.524072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.531046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:01.562404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ae705ab-ca56-4637-9e04-6474ecf66c19 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.425107 May 10 14:17:01.566553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 36/73] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:01 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:01.630055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-19c1aeae-4918-4233-9d44-b0134b2eceba req-673be702-5e7e-42eb-a140-bac39dfba720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8bc09f-ec85-4865-93b7-28628f5b8797", "tag": "c26e2828-6b17-4743-bbb3-84d8dc58732a"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:01.659149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-19c1aeae-4918-4233-9d44-b0134b2eceba req-673be702-5e7e-42eb-a140-bac39dfba720 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.660158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-19c1aeae-4918-4233-9d44-b0134b2eceba req-673be702-5e7e-42eb-a140-bac39dfba720 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.697418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-19c1aeae-4918-4233-9d44-b0134b2eceba req-673be702-5e7e-42eb-a140-bac39dfba720 service nova] Creating event network-changed:c26e2828-6b17-4743-bbb3-84d8dc58732a for instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 on hv-cinder-84112 May 10 14:17:01.706506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-19c1aeae-4918-4233-9d44-b0134b2eceba req-673be702-5e7e-42eb-a140-bac39dfba720 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084985 May 10 14:17:01.708421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 37/74] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:17:01.718128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:01.727289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:01.728736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.729251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.730458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.731260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.764652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:01.774768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2b6f5ca-3ca6-4e4c-9649-112103b1fcd4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.271930 May 10 14:17:01.775876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 38/75] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:01 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:01.803716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:01.804415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:01.815550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.815992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.816955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:01.817659 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:01.825891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:01.847700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:01.849983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:01.853045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0400a30d-98cd-457a-8c88-d11a4915fe97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1277 microversion: 2.20 time: 0.142928 May 10 14:17:01.861992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:01.934661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:01.945655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-364ac881-ac35-4d6e-a9f3-69d5ae7d4952 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1237 microversion: 2.1 time: 0.144567 May 10 14:17:01.947796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 39/77] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:01 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1237 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:02.478047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:02.478690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:02.484564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.485007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:02.486810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.487809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:02.577290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:02.586087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:02.586736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:02.590739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ea891588-b8c0-4b42-b674-2f6ea0492870 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1241 microversion: 2.1 time: 0.115835 May 10 14:17:02.592073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 39/78] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:02.602677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.603131 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:02.604369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.604881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:02.794775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:02.795387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:02.804881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.805327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:02.806105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.806567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:02.965933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:02.973315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59a2976d-2119-427f-acf3-c3d3f1c30fac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.391519 May 10 14:17:02.973885 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 40/79] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:02 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:02.986191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:02.986854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:02.993277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.993961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:02.994795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:02.995228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:03.020945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:03.030667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-36b8bf4a-ae99-4fa0-b913-f0447b2e2b31 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.241302 May 10 14:17:03.031944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 40/80] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:02 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:03.037093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:03.037858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:03.043846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:03.044397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:03.045167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:03.045594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:03.069522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:03.072890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:03.074506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:03.075715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f66aff10-7fe2-4ab2-88d4-c87a909143fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1277 microversion: 2.20 time: 0.100703 May 10 14:17:03.076279 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 41/81] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:03.109222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:03.116873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71846663-5fd2-4976-9043-546559f52924 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1237 microversion: 2.1 time: 0.084376 May 10 14:17:03.117440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 41/82] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:03 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:03.608959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:03.609562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:03.616503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:03.616958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:03.617738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:03.618268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:03.685127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:03.697230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1dd57f4-dd53-49ed-a0d8-0529c10f66ea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1241 microversion: 2.1 time: 0.091968 May 10 14:17:03.708175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 42/83] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:03.990844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:03.994331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:03.997667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:03.998109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:03.998932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:03.999361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.052154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:04.053045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:04.064943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.065658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.066697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.067869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.189483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:04.197272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f2a5133a-a5b1-4ca0-a21d-7d456c80ce1a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.210160 May 10 14:17:04.198408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 42/84] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:03 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:04.203091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:04.203918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:04.209957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.210678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.211940 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.212555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.272962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:04.280404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc6ee9c0-c559-4020-8df1-2158fb14ba52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.233974 May 10 14:17:04.281508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 43/85] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:04 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:04.286865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:04.287735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:04.294648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.295359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.296223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.296795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.301429 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:04.310843 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:04.312564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:04.313950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bb213794-6634-439e-99be-a2eb51fd8361 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1277 microversion: 2.20 time: 0.114061 May 10 14:17:04.314945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 43/86] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:04 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:04.370300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:04.377964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bfe3da00-b654-4d57-8b41-8235d322fe88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1237 microversion: 2.1 time: 0.094714 May 10 14:17:04.378574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 44/87] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:04 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:04.715016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:04.715701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:04.722483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.722858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.723640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:04.724078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:04.787057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:04.794652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-41dc6059-62b8-4baf-9dfc-cc8d4a13efe9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1241 microversion: 2.1 time: 0.083394 May 10 14:17:04.795238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 44/88] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:05.214873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:05.215490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:05.222228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.222748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.223589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.224085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.298899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:05.300133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:05.306173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.306938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.308040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.308927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.427644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:05.435579 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0d9eb1d-a232-42ea-8235-a7ba66198414 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.224844 May 10 14:17:05.436145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 45/89] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:05 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:05.442085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:05.442709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:05.448976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.449287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.450054 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.450505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.548665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:05.557998 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:05.559763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:05.560958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d666a5e1-6d5f-40cd-a3d4-865cf7039130 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1277 microversion: 2.20 time: 0.123656 May 10 14:17:05.565364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 46/90] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:05.565523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:05.568763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:05.569532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:05.574125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fb87576b-1eb0-470a-b330-68ad82714d68 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.279976 May 10 14:17:05.575036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 45/91] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:05 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:05.584670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.585126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.585902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.586427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.656249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:05.664686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-711bc342-ff70-4867-be11-39c1ef20558f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1237 microversion: 2.1 time: 0.101832 May 10 14:17:05.665332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 47/92] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:05 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:05.811698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:05.812306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:05.818458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.818934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.819700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:05.820141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:05.880550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:05.887878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5cdef56-9b87-4f48-a638-7409f4a7ae35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1241 microversion: 2.1 time: 0.080022 May 10 14:17:05.888452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 46/93] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:06.453803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:06.469111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:06.494429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.495141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.496196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.497473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.580523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:06.581144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:06.589418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.590546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.591589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.592939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.746321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:06.760296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:06.767448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:06.770986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d2ba0974-cef7-4eb8-b6ae-8e20255358cb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1277 microversion: 2.20 time: 0.195816 May 10 14:17:06.772626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 47/94] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:06 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:17:06.784334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:06.785516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:06.797027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.801107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.801107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.801107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.806838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:06.817843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2a08a04-c9cb-488a-b230-357a755545c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.368537 May 10 14:17:06.833507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 48/95] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:06 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:06.838099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:06.838811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:06.853672 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.856450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.857591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:06.859614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:06.966707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:06.984908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-910a4d60-78f0-493e-9b5b-38a386b30fd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1293 microversion: 2.1 time: 0.154792 May 10 14:17:06.987124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 49/96] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:06 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:06.994914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:06.996201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:07.005251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:07.006189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:07.007252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:07.007919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:07.053115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:07.073758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c3fadc9-fbd7-4154-8a89-a4822527a53e tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.298575 May 10 14:17:07.077556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 48/97] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:06 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:07.116574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:07.124252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44c2d215-6378-4c72-b61a-1a8c43057393 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1289 microversion: 2.1 time: 0.133130 May 10 14:17:07.124846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 50/98] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:07.791774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:07.792337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:07.799195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:07.799646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:07.800457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:07.801462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:07.841333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:07.842089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:07.850934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:07.851776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:07.853266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:07.853854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:07.914046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:07.931074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:07.934382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:07.936904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-43dbe18b-1a1b-42cc-ae81-5c3bfa24be66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1341 microversion: 2.20 time: 0.149930 May 10 14:17:07.950704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 49/99] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:08.025460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:08.026132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:08.049058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.053871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:08.054714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.056005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.056611 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.062550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4453fc4b-0991-4cd2-b19c-28ce74bbabde tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.225413 May 10 14:17:08.064830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 51/100] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:07 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:08.093906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:08.095441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:08.120199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.122159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.124342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.127691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.401051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:08.411373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5413645b-a83f-45ed-be79-cb8905141c01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1301 microversion: 2.1 time: 0.411107 May 10 14:17:08.413801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 50/101] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:07 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1301 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:08.424319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:08.425390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:08.439549 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.440830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.443686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.444255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.564509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:08.575196 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3d25961f-56a9-49b3-899f-992286657c23 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1297 microversion: 2.1 time: 0.159780 May 10 14:17:08.586606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 51/102] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1297 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:08.637118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:08.645952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25f65bb7-2965-49e8-8eea-8e5259168bcb tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.555883 May 10 14:17:08.665623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 52/103] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:08 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:08.746625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-8cc9a347-4fdb-4d8b-80ec-adf48d99a1f7 req-3e153436-8196-4eef-bb52-c68bc1bcd701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dfc192-c4f0-4f6b-8b06-70c5d807b5eb", "name": "network-vif-plugged", "status": "completed", "tag": "8109ea46-9ac9-42cd-bd4b-19706888d99e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:08.765373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8cc9a347-4fdb-4d8b-80ec-adf48d99a1f7 req-3e153436-8196-4eef-bb52-c68bc1bcd701 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.769168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8cc9a347-4fdb-4d8b-80ec-adf48d99a1f7 req-3e153436-8196-4eef-bb52-c68bc1bcd701 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.793427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-8cc9a347-4fdb-4d8b-80ec-adf48d99a1f7 req-3e153436-8196-4eef-bb52-c68bc1bcd701 service nova] Creating event network-vif-plugged:8109ea46-9ac9-42cd-bd4b-19706888d99e for instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb on hv-cinder-84112 May 10 14:17:08.800543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-8cc9a347-4fdb-4d8b-80ec-adf48d99a1f7 req-3e153436-8196-4eef-bb52-c68bc1bcd701 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222621 May 10 14:17:08.801738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 52/104] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:08.958812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:08.959511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:08.965740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.966282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:08.967396 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:08.967942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.049182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:09.081063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:09.081774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:09.082247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:09.085589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:09.088376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-840ca00a-ecb0-4ea1-b744-5f5e200d5fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1339 microversion: 2.20 time: 0.132282 May 10 14:17:09.090401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 53/105] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:08 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1339 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:09.109418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-4c00e0b3-d05c-4cc4-9050-221b3e2d7be0 req-c745cb30-b07f-4a19-a97b-e5f49f72cccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6950e83e-172a-43ac-b65a-de78e96476c0", "tag": "204a47a7-411c-486e-9b83-e27124ec96b4"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:09.113050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.113510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.114326 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.114767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.134027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4c00e0b3-d05c-4cc4-9050-221b3e2d7be0 req-c745cb30-b07f-4a19-a97b-e5f49f72cccc service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.134884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4c00e0b3-d05c-4cc4-9050-221b3e2d7be0 req-c745cb30-b07f-4a19-a97b-e5f49f72cccc service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.164809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-4c00e0b3-d05c-4cc4-9050-221b3e2d7be0 req-c745cb30-b07f-4a19-a97b-e5f49f72cccc service nova] Creating event network-changed:204a47a7-411c-486e-9b83-e27124ec96b4 for instance 6950e83e-172a-43ac-b65a-de78e96476c0 on hv-cinder-84112 May 10 14:17:09.165351 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4c00e0b3-d05c-4cc4-9050-221b3e2d7be0 req-c745cb30-b07f-4a19-a97b-e5f49f72cccc service nova] Acquired lock "compute-rpcapi-router" {{(pid=117660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 14:17:09.173795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f682cc6-3618-4d6e-8e65-2c6927f8d1d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.174533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f682cc6-3618-4d6e-8e65-2c6927f8d1d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.179901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f682cc6-3618-4d6e-8e65-2c6927f8d1d2 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.179901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f682cc6-3618-4d6e-8e65-2c6927f8d1d2 None None] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.195630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.compute.rpcapi [None req-1f682cc6-3618-4d6e-8e65-2c6927f8d1d2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 14:17:09.196776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f682cc6-3618-4d6e-8e65-2c6927f8d1d2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 14:17:09.218008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1f682cc6-3618-4d6e-8e65-2c6927f8d1d2 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120852 May 10 14:17:09.219327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 54/106] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:09.433963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:09.434803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:09.443686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.443686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.443959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.445162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.545001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:09.565267 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13356d6b-05e5-4324-8079-a06ac7c2ecbe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1299 microversion: 2.1 time: 0.138903 May 10 14:17:09.580168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 55/107] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:09 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:09.585817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-960389091", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "networks": [{"uuid": "ae79f6cb-f6c2-4f23-a0e0-b4ae12d2b434"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:09.648563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] validate_networks() for [('ae79f6cb-f6c2-4f23-a0e0-b4ae12d2b434', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:17:09.694491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:09.703237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c7e5c1a-782d-404c-b45e-9ee2f8d03db8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.627330 May 10 14:17:09.704120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 53/108] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:09 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:09.710119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:09.711038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:09.724466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.725003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.725901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.726536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.838579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:09.853949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-659f55dd-bb2c-488d-a65f-4649ef850a50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1295 microversion: 2.1 time: 0.147676 May 10 14:17:09.860902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 54/109] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1295 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:09.866137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:09.875007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:09.885535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.887626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:09.888619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:09.889232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:10.413676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:10.421716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-76fe88a4-ddd5-40c7-9d72-28eb410c579a tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.559375 May 10 14:17:10.430701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 55/110] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:09 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:10.442466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:10.443088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:10.451644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:10.452325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:10.455583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:10.457039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:10.831433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:10.846119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:10.849277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:10.850807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20e6f8dc-8d7a-46f9-a163-08e962cc4cee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.417806 May 10 14:17:10.851537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 56/111] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:10 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:10.857793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:10.858809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:10.866143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:10.866700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:10.867627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:10.868186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:10.883288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:17:10.884441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:17:10.885081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:17:10.885651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:17:10.886397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:17:10.901384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:10.904239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:10.905586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:10.907938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:10.946253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Getting quotas for project 2c1037d775114df4b21dbdfa5f639cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:17:10.946253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Getting quotas for user 7669f2f83550428893d6c91614b78f76 and project 2c1037d775114df4b21dbdfa5f639cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:17:10.963122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:17:10.966241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:17:11.064981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:11.073490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a40521fc-b232-4f11-8932-e18acbc51d6b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.220583 May 10 14:17:11.074067 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 57/112] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:10 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:11.078723 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:11.079976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:11.085704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.086142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:11.086942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.087409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:11.151744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-431e0399-1824-4d99-abfa-b0d041f79586 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572593 May 10 14:17:11.152842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 56/113] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:17:11.159065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:11.159980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:11.167401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.169265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:11.169265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.169676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:11.279885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:11.290797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a55ad7fa-f2a4-44ab-99bb-ac8d71c87008 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.215530 May 10 14:17:11.294538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 58/114] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:11 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:11.303252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7988ca49-6633-4a8c-b0de-68d784f288af tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:11.303867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7988ca49-6633-4a8c-b0de-68d784f288af tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:11.368221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7988ca49-6633-4a8c-b0de-68d784f288af tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:11.375556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:11.376572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7988ca49-6633-4a8c-b0de-68d784f288af tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1213 microversion: 2.1 time: 0.077331 May 10 14:17:11.377184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 59/115] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:11 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:11.382973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21fd3230-b527-4da4-a0a2-ad673f00e714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.229023 May 10 14:17:11.383534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 57/116] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:11 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:11.444239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:11.444927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:11.455097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.455689 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:11.456671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.457038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:11.647208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:11.657029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0bc65265-f003-44bb-bb40-a76a2809817f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.218285 May 10 14:17:11.657616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 60/117] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:11 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:11.870094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:11.870722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:11.877102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.877580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:11.878355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:11.878784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.014712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.022844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.024336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.025424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15375386-a221-40a4-bcfb-17dceba0494e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.159199 May 10 14:17:12.025988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 58/118] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:11 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:12.091485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:12.092092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:12.098594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.099041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.099840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.100272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.259601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.267755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f31aece2-16ff-4b2f-8383-047f0949b829 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.180061 May 10 14:17:12.268404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 61/119] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:12 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:12.309014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:12.309412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:12.316543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.317238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.318187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.318786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.394963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:12.395929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:12.406314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.407028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.408970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.409738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.526534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.536971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d1682803-146b-46bc-82ba-622d479c4771 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1217 microversion: 2.1 time: 0.146402 May 10 14:17:12.547381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 62/120] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:12 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:12.547381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:12.547381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:12.553435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.561983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.561983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.561983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.691038 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.699345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-88456daf-b4d1-4c37-9a90-a2ea5e081451 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.395148 May 10 14:17:12.713004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 59/121] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:12 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:12.719227 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:12.721285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:12.728333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.728780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.729553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:12.729982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:12.842953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.853365 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-43cc6651-0083-4189-bf39-0fa63af26511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.313811 May 10 14:17:12.853783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 63/122] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:12.947273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:12.955954 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d51e08ee-f034-41ac-b7ac-587855fb1ed4 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1314 microversion: 2.1 time: 0.241613 May 10 14:17:12.957150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 60/123] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:12 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:13.044660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:13.045280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:13.052368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.052979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.053798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.054241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.285449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:13.286061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:13.302139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.302621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.303573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.307134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.454405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:13.464135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:13.466000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:13.467367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0b0c4b14-211f-4341-9d65-5a77d68fe861 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.427477 May 10 14:17:13.469684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 64/124] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:13 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:17:13.555536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:13.556778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:13.564001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.565034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.566081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.566731 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.591719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:13.607461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e134860-338c-41f5-85f7-bd93093eafe9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.326178 May 10 14:17:13.608617 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 61/125] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:13 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:13.661419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:13.676708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-79ed8de3-aad5-4554-8adb-88150c6c4bc1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1265 microversion: 2.1 time: 0.125113 May 10 14:17:13.686291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 65/126] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:13 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:13.726749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:13.728055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:13.763812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.778896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.784910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.784910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.871820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:13.872474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:13.887472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.889113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:13.889952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:13.894675 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:14.354986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:14.363874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72449f5c-43d2-468a-9049-5ec4c7a5a527 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.649518 May 10 14:17:14.367454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 62/127] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:13 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:14.373887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:14.374740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:14.385645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:14.393251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:14.394571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ee31854e-36bd-42dd-bfc8-8830a6294217 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.528231 May 10 14:17:14.394736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:14.395160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 66/128] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:14.396736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:14.397309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:14.491080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:14.491704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:14.502258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:14.505052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:14.506075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:14.506729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:14.627084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:14.641259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c5c9c8f6-a43a-498a-9a9e-a995ae477df3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1502 microversion: 2.1 time: 0.272545 May 10 14:17:14.644785 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 63/129] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:14 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:14.650302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:14.658082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:14.674192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:14.675034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:14.676064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:14.676598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.050071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:15.067776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:15.069302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:15.071183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-90820123-c784-4143-ba52-e043c435971b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.589044 May 10 14:17:15.092267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 67/130] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:17:15.100328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:15.100939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:15.108091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.108767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.109702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.110896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.234257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:15.240152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:15.247188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-025e77cf-bf8e-4702-859b-f2a2e8001c21 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1273 microversion: 2.1 time: 0.150568 May 10 14:17:15.247797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 68/131] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:15 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:15.256649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b53ea3fd-7632-414a-8e34-d023e993dee1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.603697 May 10 14:17:15.256649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 64/132] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:14 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:15.259618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-ee3b3601-81d9-4179-bced-07872de5e493 req-5fc01ff8-45fb-4e1b-9107-32fb950437ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be793a1-f88b-4fb2-8e17-41545f3a5ee3", "tag": "583a709c-2a69-46cd-b56e-2731e7886ba1"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:15.269189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ee3b3601-81d9-4179-bced-07872de5e493 req-5fc01ff8-45fb-4e1b-9107-32fb950437ea service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.270105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ee3b3601-81d9-4179-bced-07872de5e493 req-5fc01ff8-45fb-4e1b-9107-32fb950437ea service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.296780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-ee3b3601-81d9-4179-bced-07872de5e493 req-5fc01ff8-45fb-4e1b-9107-32fb950437ea service nova] Creating event network-changed:583a709c-2a69-46cd-b56e-2731e7886ba1 for instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 on hv-cinder-84112 May 10 14:17:15.311614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-ee3b3601-81d9-4179-bced-07872de5e493 req-5fc01ff8-45fb-4e1b-9107-32fb950437ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056048 May 10 14:17:15.315366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 65/133] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:15.384202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:15.384901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:15.400383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.401138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.401582 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-978475f1-f637-40ae-908a-d12b1f879f1a req-ae2fd2b6-aa36-46c5-bc1b-c8b677bd897f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9825c2a-925f-439c-835d-00b5aade9041", "tag": "180675a4-4ac8-4200-88cf-1263e04176e0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:15.401898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.402515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.411626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-978475f1-f637-40ae-908a-d12b1f879f1a req-ae2fd2b6-aa36-46c5-bc1b-c8b677bd897f service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.414485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-978475f1-f637-40ae-908a-d12b1f879f1a req-ae2fd2b6-aa36-46c5-bc1b-c8b677bd897f service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.425491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-978475f1-f637-40ae-908a-d12b1f879f1a req-ae2fd2b6-aa36-46c5-bc1b-c8b677bd897f service nova] Creating event network-changed:180675a4-4ac8-4200-88cf-1263e04176e0 for instance f9825c2a-925f-439c-835d-00b5aade9041 on hv-cinder-84112 May 10 14:17:15.431369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-978475f1-f637-40ae-908a-d12b1f879f1a req-ae2fd2b6-aa36-46c5-bc1b-c8b677bd897f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180558 May 10 14:17:15.432630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 69/134] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:15.438298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:15.440482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:15.449591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.450398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.452322 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:15.452845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:15.673146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:15.680553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ee8c28f-6356-43f7-8a09-833bf267e8db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.246539 May 10 14:17:15.681146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 70/135] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:15.709848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:15.717387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ba75655-ff8a-43c0-8baa-53b6ac61850c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.337444 May 10 14:17:15.718157 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 66/136] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:15 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:16.089259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:16.089872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:16.096032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.096480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.097250 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.097682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.261324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:16.266491 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:16.267797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:16.270912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:16.272392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:16.273508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fc5bf9d8-40c1-4a47-89a1-5a3570ea8cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.188116 May 10 14:17:16.273866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.274061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 71/137] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:16 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:16.274371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.275142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.275620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.278828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:16.279416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:16.287734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.288174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.288934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.289359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.338895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:16.346408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5418cc2-d824-4f16-8365-94447d013943 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1273 microversion: 2.1 time: 0.083815 May 10 14:17:16.347168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 67/138] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:16 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:16.472755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:16.481306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a8112a98-f9d3-4570-a8b7-2634deb5bd6f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.206138 May 10 14:17:16.482299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 72/139] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:16 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:16.517916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-149cd8d1-f464-4320-9abb-c54082d4b997 req-79984f54-16fa-4822-a98f-fcf8e813c2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8bc09f-ec85-4865-93b7-28628f5b8797", "name": "network-vif-plugged", "status": "completed", "tag": "c26e2828-6b17-4743-bbb3-84d8dc58732a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:16.539667 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-149cd8d1-f464-4320-9abb-c54082d4b997 req-79984f54-16fa-4822-a98f-fcf8e813c2ed service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.540107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-149cd8d1-f464-4320-9abb-c54082d4b997 req-79984f54-16fa-4822-a98f-fcf8e813c2ed service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.553077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-149cd8d1-f464-4320-9abb-c54082d4b997 req-79984f54-16fa-4822-a98f-fcf8e813c2ed service nova] Creating event network-vif-plugged:c26e2828-6b17-4743-bbb3-84d8dc58732a for instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 on hv-cinder-84112 May 10 14:17:16.558639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a3841aff-fbc7-4516-a434-c24d38cecea0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edcef1e3-d1af-4582-8470-bc0cbda28b99"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:16.559376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-149cd8d1-f464-4320-9abb-c54082d4b997 req-79984f54-16fa-4822-a98f-fcf8e813c2ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045805 May 10 14:17:16.559867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a3841aff-fbc7-4516-a434-c24d38cecea0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:16.560035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 68/140] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:16.569114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3841aff-fbc7-4516-a434-c24d38cecea0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.569114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3841aff-fbc7-4516-a434-c24d38cecea0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.569114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3841aff-fbc7-4516-a434-c24d38cecea0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.569409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3841aff-fbc7-4516-a434-c24d38cecea0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.699634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:16.700457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:16.716277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.716277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.716277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.716277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.894962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:16.904749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b01ff284-981a-4f76-a3da-6a256d8cf13d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.209749 May 10 14:17:16.906405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 69/141] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:16.913305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:16.914060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:16.924017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.925332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:16.926298 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:16.926863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.247734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:17.257426 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33537b0a-7009-4b05-933e-a36b679a2150 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.349247 May 10 14:17:17.258273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 70/142] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:16 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:17.292730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:17.294064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:17.303634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.304118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.305048 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.305556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.702102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:17.715465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:17.722778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:17.724926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a3841aff-fbc7-4516-a434-c24d38cecea0 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "POST /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171744 May 10 14:17:17.728529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ec1ac9e8-92de-407c-88d2-02d62ea80b43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.441394 May 10 14:17:17.728937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 73/143] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:17:16 2022] POST /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb/os-volume_attachments => generated 194 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:17:17.731089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 71/144] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:17 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:17:17.739176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:17.741086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-c6b11b43-fe03-4f51-bb7d-b3ba5ed9cd14 req-07e6d93d-a566-49c8-a64b-359fd9b9c76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a50ebb-7db2-481e-a381-14f2aa6f3ec9", "tag": "b322516a-ad64-4f70-89e2-1b69a91a3ade"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:17.742086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:17.759823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.760303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.761085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.761514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.763477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-c6b11b43-fe03-4f51-bb7d-b3ba5ed9cd14 req-07e6d93d-a566-49c8-a64b-359fd9b9c76d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.763929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-c6b11b43-fe03-4f51-bb7d-b3ba5ed9cd14 req-07e6d93d-a566-49c8-a64b-359fd9b9c76d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.791092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-c6b11b43-fe03-4f51-bb7d-b3ba5ed9cd14 req-07e6d93d-a566-49c8-a64b-359fd9b9c76d service nova] Creating event network-changed:b322516a-ad64-4f70-89e2-1b69a91a3ade for instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 on hv-cinder-84112 May 10 14:17:17.803390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-c6b11b43-fe03-4f51-bb7d-b3ba5ed9cd14 req-07e6d93d-a566-49c8-a64b-359fd9b9c76d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070927 May 10 14:17:17.804879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 72/145] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:17.811790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:17.812865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:17.821295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.821896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.822901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.823469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.875870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:17.885436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3267a13d-d854-47ed-9e47-fcd73cf1c96d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1271 microversion: 2.1 time: 0.155103 May 10 14:17:17.886018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 74/146] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:17 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:17.924736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:17.925167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:17.933173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.933296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:17.934064 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:17.934536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:18.208529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:18.216202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a07aa6c7-2859-4764-8d22-951caef8bcf2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.409802 May 10 14:17:18.216992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 73/147] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:17 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:18.278637 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:18.279461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:18.286434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:18.286893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:18.287727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:18.288709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:18.289336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:18.293672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8f3f2039-b09a-49e4-985f-06b448952876 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.373046 May 10 14:17:18.303049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 75/148] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:18.440829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:18.448369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0e02268-e68b-4760-a246-99cb467593c7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.173885 May 10 14:17:18.449343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 74/149] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:18 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:18.758189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:18.759465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:18.768621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:18.769772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:18.770545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:18.771120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:18.904076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:18.906039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:18.913382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:18.915342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:18.916505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:18.917111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.002357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:19.013601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:19.015810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:19.020236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-65f83266-e389-4f01-819b-191c75e19242 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.268039 May 10 14:17:19.020236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 76/150] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:18 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:19.076425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:19.084550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b7f1313-bb31-4c83-9a0f-dc194d5a9255 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.184387 May 10 14:17:19.085122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 75/151] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:18 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:19.237126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:19.238055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:19.247764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:19.252439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.253431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:19.253868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.310599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:19.311522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:19.317914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:19.318393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.319364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:19.319798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.526751 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:19.535696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-960203ad-6db2-4c70-b89a-5b97083830aa tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.303003 May 10 14:17:19.536287 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 77/152] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:19 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:19.541753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:19.543893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:19.549180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:19.549628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.550649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:19.551463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.558354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:19.591360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa578756-d253-4dab-8ca4-701473748073 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.284848 May 10 14:17:19.591940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 76/153] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:19.693572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:19.701108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e5302a4-e9ac-4937-8ca8-a3aa35c66f04 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.163553 May 10 14:17:19.701721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 78/154] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:19 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:19.826357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-2698af04-bd0b-453f-86ed-26731c05c292 req-38400c24-fc56-46a0-9a01-f9bf211f9aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58de3c26-b856-4d33-9880-9a5a94019241", "tag": "f94ff5bb-e555-4366-b867-9c06734b0a39"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:19.834424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2698af04-bd0b-453f-86ed-26731c05c292 req-38400c24-fc56-46a0-9a01-f9bf211f9aa7 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:19.834869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2698af04-bd0b-453f-86ed-26731c05c292 req-38400c24-fc56-46a0-9a01-f9bf211f9aa7 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:19.846176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-2698af04-bd0b-453f-86ed-26731c05c292 req-38400c24-fc56-46a0-9a01-f9bf211f9aa7 service nova] Creating event network-changed:f94ff5bb-e555-4366-b867-9c06734b0a39 for instance 58de3c26-b856-4d33-9880-9a5a94019241 on hv-cinder-84112 May 10 14:17:19.851215 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-2698af04-bd0b-453f-86ed-26731c05c292 req-38400c24-fc56-46a0-9a01-f9bf211f9aa7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028948 May 10 14:17:19.851927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 77/155] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:20.037895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:20.038531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:20.044492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.044931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.045678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.046099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.101987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:20.102794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:20.109626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.110070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.111481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.112075 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.242482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:20.250861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:20.252923 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:20.254044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2fd8e3dd-14b8-479a-a8ec-50a47fed0060 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.220849 May 10 14:17:20.254868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 79/156] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:20 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:20.273354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:20.280558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dbaa88a3-cba7-452e-893e-fcad0f0972fa tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.183382 May 10 14:17:20.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 78/157] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:20 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:20.552839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:20.553492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:20.559350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.559804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.560575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.561009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.609469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:20.609947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:20.616457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.617219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.618069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.618589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.770499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:20.778421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a38c4781-f4c6-497b-a59d-141aeb052b17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.229133 May 10 14:17:20.778421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 80/158] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:20 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:20.783622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-3749e407-1749-460f-b8ee-6b3b64cc9526 req-b21fed50-4968-4798-8b47-7a304651202c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6950e83e-172a-43ac-b65a-de78e96476c0", "name": "network-vif-plugged", "status": "completed", "tag": "204a47a7-411c-486e-9b83-e27124ec96b4"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:20.791760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3749e407-1749-460f-b8ee-6b3b64cc9526 req-b21fed50-4968-4798-8b47-7a304651202c service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.792194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3749e407-1749-460f-b8ee-6b3b64cc9526 req-b21fed50-4968-4798-8b47-7a304651202c service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.797743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:20.807696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-3749e407-1749-460f-b8ee-6b3b64cc9526 req-b21fed50-4968-4798-8b47-7a304651202c service nova] Creating event network-vif-plugged:204a47a7-411c-486e-9b83-e27124ec96b4 for instance 6950e83e-172a-43ac-b65a-de78e96476c0 on hv-cinder-84112 May 10 14:17:20.807831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eaf2af0d-bb02-4d47-8523-08678e4a09d9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.201545 May 10 14:17:20.807831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 79/159] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:20.811337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-3749e407-1749-460f-b8ee-6b3b64cc9526 req-b21fed50-4968-4798-8b47-7a304651202c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 May 10 14:17:20.812300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 81/160] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:20.813453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:20.814265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:20.820260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.820708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.821472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:20.821933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:20.951376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:20.959740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c55bad85-c71f-43a3-b3b2-162c367bf0c5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.151899 May 10 14:17:20.969384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 80/161] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:20 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:21.272831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:21.273527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:21.279550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.289191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:21.289191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.289191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:21.297658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:21.299362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:21.305262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.305720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:21.306522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.306961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:21.477663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:21.485655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:21.487189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:21.488301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3f4060ae-6bf9-433a-9ebe-ef2cbe0a1b56 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.220171 May 10 14:17:21.488862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 82/162] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:21 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:21.490264 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:21.498382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a22e2dc3-369b-404a-b7fb-62ed2c89e839 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.204569 May 10 14:17:21.498975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 81/163] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:21 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:21.805198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:21.805198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:21.805198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.805198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:21.805602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.805602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:21.824760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:21.825436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:21.832707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.833337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:21.834175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:21.834712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:22.026023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:22.033993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:22.038763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d021e920-334c-4dbe-98a1-818a0052a971 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.246861 May 10 14:17:22.041268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 83/164] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:21 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:22.043739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:22.044350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:22.045341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00534430-e512-4da6-85c7-b1f16b5f135c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.225332 May 10 14:17:22.047649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 82/165] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:22.051852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:22.052298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:22.053318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:22.053755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:22.191809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:22.199380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cdc3307e-ec55-45aa-a518-8e1ca701c8ab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.159059 May 10 14:17:22.200170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 84/166] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:22 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:22.505981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:22.506611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:22.515486 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:22.516088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:22.523426 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:22.527477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:22.527477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:22.527477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:22.528329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:22.537822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:22.538782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:22.539229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:22.729539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:22.732290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:22.738081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:22.739814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:22.741248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78a71d08-4489-445b-ad2e-bcdd09f4d140 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.238862 May 10 14:17:22.741868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 83/167] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:22.742864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e483fcb9-463a-4444-92a5-93fc0e933a80 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.231179 May 10 14:17:22.743535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 85/168] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:22 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:23.055861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:23.056618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:23.062086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:23.062548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.062869 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:23.063071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.064370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.065368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.070476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.071006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.071880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.072382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.443185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:23.446854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:23.450487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1984d502-2637-46cf-8d4f-64cb15bfdc9b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.398418 May 10 14:17:23.451237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 84/169] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:23 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:23.459867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-15008d1f-2983-4e6d-ace6-fc2795d74503 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.395995 May 10 14:17:23.459867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 86/170] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:23.459867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:23.460194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:23.465962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.466440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.467201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.467631 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.617685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:23.624937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a5ee2ef4-e6db-49ad-9c5b-813559cbae73 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.168887 May 10 14:17:23.625509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 87/171] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:23 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:23.760697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:23.761289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:23.763353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:23.763974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:23.767447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.767922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.768656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.769080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.773098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.773098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:23.773098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:23.773098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:24.014527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:24.019140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:24.023390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:24.024993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:24.026228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c7749e3-b378-4f31-9abb-51e9b05a992b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.269437 May 10 14:17:24.026820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6db2b07f-077a-489c-aa69-78f347e87207 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.267297 May 10 14:17:24.027741 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 88/172] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:23 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:24.031333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 85/173] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:23 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:24.467668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:24.468275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:24.471439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:24.472048 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:24.474769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:24.475219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:24.475986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:24.476416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:24.478109 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:24.478588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:24.479352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:24.479787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:24.672748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:24.677718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:24.680788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-870d8ec4-c564-46fd-b704-85ede08af51e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.217191 May 10 14:17:24.681367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 89/174] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:24 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:24.685793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a4c324a-a1fe-4944-a087-1d09154b3755 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.218462 May 10 14:17:24.686275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:24.686599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 86/175] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:24.687191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:24.693636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:24.694081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:24.694873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:24.695294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:24.827026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:24.834672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1c4005f9-e06e-4eca-ae38-0f70e1b4726c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.151779 May 10 14:17:24.835669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 90/176] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:24 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:25.044786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:25.045501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:25.051222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:25.051839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:25.057687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.058132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.059108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.059534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.060833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.061291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.067327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.067780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.271187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:25.279357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:25.280862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:25.282822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bdcf3a9d-ae4a-4783-9c13-4bf6ae4b9510 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.241359 May 10 14:17:25.293685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 87/177] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:25 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:25.293924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:25.295528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-63320921-22da-4268-bb80-7dc7033d48cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.248711 May 10 14:17:25.296167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 91/178] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:25 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:25.698318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:25.698926 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:25.706062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.706459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.707227 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.707661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.707973 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:25.708594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:25.714624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.715076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.715839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.716273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.897777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:25.904956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d9814fe5-c9b9-4f0a-880c-5f7ab2dee791 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.210427 May 10 14:17:25.905127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:25.905522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 88/179] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:25 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:25.910919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:25.911514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:25.916038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffc4b5fa-3a47-472a-8d1d-bb5e24357b7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.211813 May 10 14:17:25.916968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 92/180] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:25.917317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.917792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:25.918694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:25.919119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.056253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:26.064218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b6fe645e-b25b-424f-8e9e-dff958275902 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.157272 May 10 14:17:26.064784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 89/181] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:25 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:26.301570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:26.302169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:26.308004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.308443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.309268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.309628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.313236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:26.314554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:26.320706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.321153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.321916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.322406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.510005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:26.520167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:26.521726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:26.522382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:26.522924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-724781ff-6a3b-4359-9aaf-3c119a5fd5fb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.225732 May 10 14:17:26.523487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 93/182] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:26 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:26.530082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7165944c-903c-4da6-ab09-32522559da26 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.220955 May 10 14:17:26.530828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 90/183] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:26 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:26.921775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:26.922458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:26.930374 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.930825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.931595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.932204 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.932986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:26.934345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:26.940153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.940598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:26.941387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:26.941814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:27.134906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:27.140650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cfcb08d4-8b90-47d9-808d-9eae548fa5ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.223095 May 10 14:17:27.141217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 94/184] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:26 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:27.145451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:27.146435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:27.147040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:27.152944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:27.153393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:27.154111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0dce33b5-c8c8-4ecf-9231-f714fbeb22a8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.225232 May 10 14:17:27.154259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:27.154597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:27.155006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 91/185] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:27.294537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:27.302156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ea3944db-41dc-495c-b3bd-b50fc4c29a97 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.159371 May 10 14:17:27.302996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 95/186] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:27 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:27.541748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:27.542732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:27.549053 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:27.549986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:27.560233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:27.561954 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:27.562674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:27.563374 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:27.564886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:27.565903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:27.566558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:27.567150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:27.786861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:27.794628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8feab792-9bae-40fb-b890-e2e2eae83e1a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.249565 May 10 14:17:27.795127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 96/187] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:27 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:27.833340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:27.845953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:27.847825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:27.849556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58f22e63-d40c-40dc-bdf8-fa53fb4c098e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.311550 May 10 14:17:27.861225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 92/188] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:27 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:28.159254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:28.159872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:28.166572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.167026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.171398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.172041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.172550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:28.173873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:28.180137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.180576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.181413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.181912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.535203 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:28.544673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d628d69e-0aec-48d7-afa9-1d741bfa5cb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.375739 May 10 14:17:28.547064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 93/189] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:28.566037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:28.566037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:28.570062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.572021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.572128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:28.572232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.572540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.583172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-31c37008-3671-4d12-bcaa-aa989c319a01 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.428417 May 10 14:17:28.584150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 97/190] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:28 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:28.812396 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:28.813016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:28.823043 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.830435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.831900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.831900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.869524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:28.878027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-60e72b5c-a228-4d10-8770-48e328ec0cef tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.328994 May 10 14:17:28.883200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 94/191] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:28 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:28.903650 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:28.903650 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:28.910251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.915810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:28.915810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:28.915810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:29.087134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:29.094993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9fac65ce-04fc-4201-bb8b-88ad346dfc30 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.286748 May 10 14:17:29.095863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 98/192] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:28 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:29.114805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:29.122817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:29.124308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:29.125399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-98c318ca-6b00-4e69-b5ef-2f156b4294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.241169 May 10 14:17:29.126106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 95/193] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:29.547964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-a58a69e7-7694-497b-a026-47ca56a2cd66 req-fe2de4c1-850c-4a5e-989e-b224ead003cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a50ebb-7db2-481e-a381-14f2aa6f3ec9", "name": "network-vif-plugged", "status": "completed", "tag": "b322516a-ad64-4f70-89e2-1b69a91a3ade"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:29.558779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-a58a69e7-7694-497b-a026-47ca56a2cd66 req-fe2de4c1-850c-4a5e-989e-b224ead003cb service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:29.559225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-a58a69e7-7694-497b-a026-47ca56a2cd66 req-fe2de4c1-850c-4a5e-989e-b224ead003cb service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:29.573777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:29.574734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:29.584735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-a58a69e7-7694-497b-a026-47ca56a2cd66 req-fe2de4c1-850c-4a5e-989e-b224ead003cb service nova] Creating event network-vif-plugged:b322516a-ad64-4f70-89e2-1b69a91a3ade for instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 on hv-cinder-84112 May 10 14:17:29.585244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:29.586146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:29.587930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:29.588441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:29.591355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-a58a69e7-7694-497b-a026-47ca56a2cd66 req-fe2de4c1-850c-4a5e-989e-b224ead003cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049692 May 10 14:17:29.592080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 99/194] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:29.614112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:29.615704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:29.627075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:29.628437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:29.629554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:29.630146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:29.822801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:29.829034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1543d4c2-6e3a-42c1-9aec-d925c2b490f5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.259772 May 10 14:17:29.830550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 96/195] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:29.840029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:29.848785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4a04ead-7f95-40bb-8557-5bd7d19317a8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.247306 May 10 14:17:29.849596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 100/196] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:29 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:29.912080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:29.912687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:29.919557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:29.920012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:29.920979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:29.921417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.062597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:30.070500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-216d92f9-0a99-4e18-81a7-d0ee3f628531 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.162543 May 10 14:17:30.071282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 97/197] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:29 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:30.112516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:30.113052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:30.119244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.119831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.120682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.121200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.144508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:30.145112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:30.151646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.152091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.152861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.153294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.308270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:30.313413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f41c5e87-e07e-4e04-a714-5511a509746c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.204773 May 10 14:17:30.314566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 101/198] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:30 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:30.334526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:30.342310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:30.343798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:30.346132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b9bebee-89a1-4b4d-95ad-ae15ce95d3e8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.206177 May 10 14:17:30.346917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 98/199] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:30 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:30.847638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:30.848240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:30.854583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.855021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.855769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.856456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.866222 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:30.866988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:30.872923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.873271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:30.874042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:30.874504 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.050854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:31.059173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e38f266d-2e0b-4bd9-974d-585a423ec95d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.215994 May 10 14:17:31.060388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 102/200] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:31.065672 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:31.075618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ec238497-aa7e-47a8-9e69-8ed50c7e5bf6 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.213381 May 10 14:17:31.076289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 99/201] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:30 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:31.087970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:31.088666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:31.095394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:31.095394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.096120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:31.096550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.224412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:31.231539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5a72c289-407f-47fa-b68f-06c662f89b48 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.147689 May 10 14:17:31.232106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 103/202] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:31 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:31.331280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:31.331861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:31.337829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:31.338539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.339320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:31.339756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.368302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:31.369272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:31.378822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:31.379812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.380971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:31.382068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.532663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:31.549370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c606eb5-a6a5-4619-9257-16d88e6f506e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.222828 May 10 14:17:31.550086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 100/203] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:31 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:31.576931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:31.586701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:31.588276 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:31.589521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0092820f-87f0-4193-b98b-40d202af417f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.227561 May 10 14:17:31.590178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 104/204] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:31 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:31.652167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-8023c7df-f535-44dc-97d5-3123f1498f93 req-f542d30a-2193-4d98-9cf2-2e24f390bdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9825c2a-925f-439c-835d-00b5aade9041", "name": "network-vif-plugged", "status": "completed", "tag": "180675a4-4ac8-4200-88cf-1263e04176e0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:31.661139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-8023c7df-f535-44dc-97d5-3123f1498f93 req-f542d30a-2193-4d98-9cf2-2e24f390bdf2 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:31.661658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-8023c7df-f535-44dc-97d5-3123f1498f93 req-f542d30a-2193-4d98-9cf2-2e24f390bdf2 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:31.674962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-8023c7df-f535-44dc-97d5-3123f1498f93 req-f542d30a-2193-4d98-9cf2-2e24f390bdf2 service nova] Creating event network-vif-plugged:180675a4-4ac8-4200-88cf-1263e04176e0 for instance f9825c2a-925f-439c-835d-00b5aade9041 on hv-cinder-84112 May 10 14:17:31.681309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-8023c7df-f535-44dc-97d5-3123f1498f93 req-f542d30a-2193-4d98-9cf2-2e24f390bdf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032409 May 10 14:17:31.681309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 101/205] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:32.076835 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:32.077438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:32.085052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.088173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.088173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.088173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.094761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:32.095552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:32.101976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.105657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.105657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.105657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.327357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:32.338373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-05de9178-178a-403f-9377-6e409ceb7d94 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.265156 May 10 14:17:32.340107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 105/206] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:32.347046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:32.348038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:32.350964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:32.356594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.357318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.358136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.358609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.365819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e9eaca6-e4b2-4913-bd38-59044c3c3c67 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.275238 May 10 14:17:32.375137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 102/207] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:32 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:32.566143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:32.566770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:32.572929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.573384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.574227 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.574830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.809256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:32.831481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6fdf4977-85d7-4809-a7d6-fee5618df27b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1320 microversion: 2.1 time: 0.487337 May 10 14:17:32.832444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 106/208] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:32 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:32.842114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:32.843883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:32.856506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:32.857794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.859676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.863423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:32.864080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:32.865682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3afe29a9-b83d-49d3-9ce4-78678a3bdeb8 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.303973 May 10 14:17:32.868048 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 103/209] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:32 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:33.051164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:33.077725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:33.081399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:33.083801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1d71cece-fe37-43f6-b82d-a105633340a7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.247967 May 10 14:17:33.084371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 107/210] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:33.356210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:33.356842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:33.364214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.364720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:33.365497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.365949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:33.384796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:33.386636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:33.408726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.410572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:33.410572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.410774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:33.682765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:33.692705 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-653c059d-f1e2-439e-b569-88c294da97a2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.340360 May 10 14:17:33.694034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 104/211] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:33 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:33.721927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:33.734221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c6d8f3d5-c743-426a-bb9a-3a22ac29fba0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.351871 May 10 14:17:33.734927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 108/212] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:33 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:33.849591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:33.850401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:33.858327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.858649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:33.860332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.860966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:33.884758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:33.885364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:33.891279 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.891723 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:33.893031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:33.893463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.075882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:34.083881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e137bca9-89d2-4d11-9236-f2c4180575f9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1514 microversion: 2.1 time: 0.238969 May 10 14:17:34.099445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:34.102475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 105/213] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:33 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:34.107974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:34.108117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ecbef15-7e93-4ce7-aa93-61d855141067 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.226769 May 10 14:17:34.108656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 109/214] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:33 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:34.115256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:34.115997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:34.122251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.122707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.123448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:34.123586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.123898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.130775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.135649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.135649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.135649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.162290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lazy-loading 'flavor' on Instance uuid 6950e83e-172a-43ac-b65a-de78e96476c0 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:17:34.335846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:34.346045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:34.348241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:34.349577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-badd9115-bdae-4f70-adf1-6c21c70feff4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.246063 May 10 14:17:34.354001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 106/215] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:34 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:34.653957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-419b5772-2419-4529-8c44-dd01c1fbeb5e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0/action" status: 200 len: 32 microversion: 2.1 time: 0.543890 May 10 14:17:34.654673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 110/216] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:17:34 2022] POST /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0/action => generated 32 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:17:34.663769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:34.664961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:34.670829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.671574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.676688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.676688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.721045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:34.721857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:34.728405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.728848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.729645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.730071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.878096 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:34.891529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-615dcea8-a207-403d-a4bf-479ed8304df9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.231447 May 10 14:17:34.892911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 107/217] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:34 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:34.921634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:34.922488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:34.925978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:34.933097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.935373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.935482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d1277ea-816c-4b9b-bdf8-f298dd700612 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.226287 May 10 14:17:34.935564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:34.935564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:34.940195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 111/218] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:35.068391 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:35.081498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a362612f-66c0-4ba7-8c2a-a68df310e51a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.187406 May 10 14:17:35.082070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 108/219] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:34 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:35.126038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:35.126929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:35.132740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.133187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.133959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.134427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.274443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:35.282041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9329ff1b-0892-4eeb-a164-43bc7df5f2cc tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.159631 May 10 14:17:35.283199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 112/220] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:35 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:35.367957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:35.368555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:35.374449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.374891 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.375764 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.376192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.519415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:35.529147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:35.530706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:35.533657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eaccfcaa-b183-4f08-9225-c0e601ac8f6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.167749 May 10 14:17:35.533657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 109/221] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:35.752849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-58ad8b92-a8a2-4246-8dd1-4ceb377879b2 req-87624d06-410b-4214-85aa-6617f8da2084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be793a1-f88b-4fb2-8e17-41545f3a5ee3", "name": "network-vif-plugged", "status": "completed", "tag": "583a709c-2a69-46cd-b56e-2731e7886ba1"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:35.761235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-58ad8b92-a8a2-4246-8dd1-4ceb377879b2 req-87624d06-410b-4214-85aa-6617f8da2084 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.761689 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-58ad8b92-a8a2-4246-8dd1-4ceb377879b2 req-87624d06-410b-4214-85aa-6617f8da2084 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.911964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:35.912739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:35.919599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-58ad8b92-a8a2-4246-8dd1-4ceb377879b2 req-87624d06-410b-4214-85aa-6617f8da2084 service nova] Creating event network-vif-plugged:583a709c-2a69-46cd-b56e-2731e7886ba1 for instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 on hv-cinder-84112 May 10 14:17:35.924290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.924664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.925524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.925956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.931040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-58ad8b92-a8a2-4246-8dd1-4ceb377879b2 req-87624d06-410b-4214-85aa-6617f8da2084 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182457 May 10 14:17:35.931644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 113/222] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:35.951392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:35.952169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:35.958738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.959317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:35.960184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:35.960712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.129207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:36.136682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32a78e32-ff57-4149-9e27-0d77f413571c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.230731 May 10 14:17:36.137455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 110/223] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:35 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:36.147628 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:36.148852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:36.155505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.156132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.158365 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.158978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.175514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:36.185241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e86f9eed-0abc-4548-aa5c-3050e8df1fd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.237385 May 10 14:17:36.185840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 114/224] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:36.295631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:36.299975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:36.300580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:36.304940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c7801294-8368-4906-b3db-b7256b8879fd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.165891 May 10 14:17:36.305678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 111/225] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:36 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:36.306334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.306773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.307714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.308288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.455315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:36.463226 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-23231398-6a11-4cc6-8313-d6eee01eafac tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.167007 May 10 14:17:36.464017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 115/226] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:36 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:36.550114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:36.550774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:36.556780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.557226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.557988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.558480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.691858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:36.699635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:36.701155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:36.702317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b9bcedf-1ee5-4fe9-8652-993718b3b4a1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1598 microversion: 2.20 time: 0.156266 May 10 14:17:36.703090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 112/227] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:17:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:17:36.723908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-05e5e4f9-7aa4-4188-ab92-a90a65f2d75a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:36.725391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-05e5e4f9-7aa4-4188-ab92-a90a65f2d75a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:36.732626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05e5e4f9-7aa4-4188-ab92-a90a65f2d75a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.733299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05e5e4f9-7aa4-4188-ab92-a90a65f2d75a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.734275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05e5e4f9-7aa4-4188-ab92-a90a65f2d75a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:36.734719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05e5e4f9-7aa4-4188-ab92-a90a65f2d75a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:36.828179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-05e5e4f9-7aa4-4188-ab92-a90a65f2d75a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100451 May 10 14:17:36.828179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 116/228] 10.222.0.58 () {60 vars in 1315 bytes} [Tue May 10 14:17:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:17:37.154350 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:37.155144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:37.162722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.163243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:37.164117 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.164644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:37.202362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:37.203183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:37.210821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.211403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:37.212253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.212789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:37.560679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:37.568128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03c5a414-4f80-4a33-9487-762e297a8b24 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.417609 May 10 14:17:37.568821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 113/229] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:37 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:37.573408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:37.574239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:37.580701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.581126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:37.581885 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.582374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:37.606555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:37.614832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-85e526cd-db7d-46c4-b606-5f74aacbf7f7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1363 microversion: 2.1 time: 0.416206 May 10 14:17:37.616137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 117/230] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:37.622674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:37.623492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:37.631952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.632492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:37.633268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:37.633701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.115556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:38.124831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:38.128634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d197d21-5eb8-48d6-bf84-0d704943786c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.558493 May 10 14:17:38.131476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 114/231] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:37 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:38.140638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e35fbcbd-83b4-4634-9f36-55a892f8d89b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.523158 May 10 14:17:38.141431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 118/232] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:37 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:38.586228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:38.586995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:38.596419 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:38.602178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.602178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:38.602178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.610275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-4328860a-8ecf-4825-8d5a-0b7a038ae055 req-efe8da53-d21a-40ba-9b35-a74e0df95191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a50ebb-7db2-481e-a381-14f2aa6f3ec9", "tag": "b322516a-ad64-4f70-89e2-1b69a91a3ade"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:38.619873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4328860a-8ecf-4825-8d5a-0b7a038ae055 req-efe8da53-d21a-40ba-9b35-a74e0df95191 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:38.620393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4328860a-8ecf-4825-8d5a-0b7a038ae055 req-efe8da53-d21a-40ba-9b35-a74e0df95191 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.632446 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-4328860a-8ecf-4825-8d5a-0b7a038ae055 req-efe8da53-d21a-40ba-9b35-a74e0df95191 service nova] Creating event network-changed:b322516a-ad64-4f70-89e2-1b69a91a3ade for instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 on hv-cinder-84112 May 10 14:17:38.640323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-4328860a-8ecf-4825-8d5a-0b7a038ae055 req-efe8da53-d21a-40ba-9b35-a74e0df95191 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033949 May 10 14:17:38.641224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 119/233] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:17:38.647379 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:38.648253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:38.659480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:38.660097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.661055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:38.661592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.795626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:38.803403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c0c8872-b572-4146-8ea0-83d9edbf53ba tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.222033 May 10 14:17:38.812755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 115/234] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:38 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:38.843623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:38.851994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3709fadd-2c0c-4fd1-b5ea-18c61e2fb5b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1548 microversion: 2.1 time: 0.209598 May 10 14:17:38.852614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 120/235] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1548 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:38.869805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59d7814d-94c8-44b8-aaa0-6f3171fe5216 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:38.870405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59d7814d-94c8-44b8-aaa0-6f3171fe5216 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:38.877247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59d7814d-94c8-44b8-aaa0-6f3171fe5216 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:38.877247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59d7814d-94c8-44b8-aaa0-6f3171fe5216 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.878543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59d7814d-94c8-44b8-aaa0-6f3171fe5216 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:38.878762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59d7814d-94c8-44b8-aaa0-6f3171fe5216 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:38.999989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59d7814d-94c8-44b8-aaa0-6f3171fe5216 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133586 May 10 14:17:39.000457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 116/236] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 10 14:17:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:39.148144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:39.148756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:39.163802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:39.164892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:39.167303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:39.167738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:39.170416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:39.172527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:39.188251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:39.188251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:39.188251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:39.188251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:39.497534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:39.512702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:39.526623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-111e8092-304c-44d3-9618-dea5f8e8bf88 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.383507 May 10 14:17:39.528795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d3b0fc2b-753b-4378-91de-c4575d6310db tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.373717 May 10 14:17:39.534967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 117/237] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:39 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:39.535388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 121/238] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:39 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:39.821077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:39.821663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:39.827555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:39.828010 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:39.828781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:39.829211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:40.062713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:40.071751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30909211-f0a9-4ae4-b939-65d2f5baf51c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.254336 May 10 14:17:40.089896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 118/239] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:39 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:40.549912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:40.550539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:40.556258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:40.557304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:40.557431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:40.557777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:40.558765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:40.559469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:40.565188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:40.565751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:40.574185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:40.574185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:40.789387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:40.802909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cba210e6-3ca5-4058-a1ae-267adced5ed9 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.257338 May 10 14:17:40.804996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 122/240] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:40 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:40.813170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:40.819278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-64eadf4f-11a1-440a-858d-3936a599806e req-93828ab3-18a4-41b0-98e6-62badba9d9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9825c2a-925f-439c-835d-00b5aade9041", "tag": "180675a4-4ac8-4200-88cf-1263e04176e0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:40.819657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adc76ac7-b4c5-42e3-afb5-f704ddc80772 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.267452 May 10 14:17:40.820546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 119/241] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:40 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:40.830717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-64eadf4f-11a1-440a-858d-3936a599806e req-93828ab3-18a4-41b0-98e6-62badba9d9a5 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:40.831471 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-64eadf4f-11a1-440a-858d-3936a599806e req-93828ab3-18a4-41b0-98e6-62badba9d9a5 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:40.847908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-64eadf4f-11a1-440a-858d-3936a599806e req-93828ab3-18a4-41b0-98e6-62badba9d9a5 service nova] Creating event network-changed:180675a4-4ac8-4200-88cf-1263e04176e0 for instance f9825c2a-925f-439c-835d-00b5aade9041 on hv-cinder-84112 May 10 14:17:40.853293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-64eadf4f-11a1-440a-858d-3936a599806e req-93828ab3-18a4-41b0-98e6-62badba9d9a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046898 May 10 14:17:40.854132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 123/242] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:41.092043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:41.092743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:41.099895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:41.100559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:41.101369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:41.101799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:41.253027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:41.262534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9e92f76-add3-4fe2-9830-fd6c10a604be tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.174846 May 10 14:17:41.270716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 120/243] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:41 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:41.822105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:41.822996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:41.829227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:41.829746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:41.831308 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:41.831651 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:41.839271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:41.850533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:41.850533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:41.850533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:41.850533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:41.850952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:42.050460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:42.056398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:42.058383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c14de6e3-ca58-489a-8f63-bf10aae1455f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.223564 May 10 14:17:42.058977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 121/244] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:41 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:42.067303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d0415e8c-ad96-4c7b-854c-d74504fe7ead tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.249915 May 10 14:17:42.067877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 124/245] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:41 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:42.285807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:42.286510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:42.297506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:42.298884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:42.305294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:42.305294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:42.485434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:42.497535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29b1aa85-4d32-4053-bc59-1be00b203557 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.216681 May 10 14:17:42.498437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 122/246] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:42 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:43.075762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:43.076375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:43.083874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:43.084666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:43.091077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:43.091516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:43.092453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:43.092893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:43.099803 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:43.100672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:43.101668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:43.102617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:43.358048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:43.366063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:43.366591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-533453b0-5beb-425f-b1bb-222f2bad796a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.294533 May 10 14:17:43.374362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5aaa9b3c-3901-4700-818d-095fff525bbd tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.294197 May 10 14:17:43.375232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 123/247] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:43 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:43.376188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 125/248] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:43 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:43.520006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:43.520006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:43.525840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:43.526397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:43.527238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:43.527674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:43.727341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:43.735707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d29a1ba-7d2f-4cfb-ab95-02d10a61f620 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.223688 May 10 14:17:43.736454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 124/249] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:43 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:44.203382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-d5c67814-203b-4f13-8be0-740bc291680f req-c9324098-af81-4f56-9b1f-0623ed031de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58de3c26-b856-4d33-9880-9a5a94019241", "name": "network-vif-plugged", "status": "completed", "tag": "f94ff5bb-e555-4366-b867-9c06734b0a39"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:44.213276 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d5c67814-203b-4f13-8be0-740bc291680f req-c9324098-af81-4f56-9b1f-0623ed031de5 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:44.213733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d5c67814-203b-4f13-8be0-740bc291680f req-c9324098-af81-4f56-9b1f-0623ed031de5 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:44.226646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-d5c67814-203b-4f13-8be0-740bc291680f req-c9324098-af81-4f56-9b1f-0623ed031de5 service nova] Creating event network-vif-plugged:f94ff5bb-e555-4366-b867-9c06734b0a39 for instance 58de3c26-b856-4d33-9880-9a5a94019241 on hv-cinder-84112 May 10 14:17:44.232122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-d5c67814-203b-4f13-8be0-740bc291680f req-c9324098-af81-4f56-9b1f-0623ed031de5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032386 May 10 14:17:44.233505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 126/250] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:44.383381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:44.384177 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:44.392531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:44.393248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:44.394302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:44.395392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:44.397585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:44.398360 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:44.406042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:44.406891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:44.408984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:44.409751 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:44.696124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:44.699322 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:44.709576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76a71853-0946-474a-b69d-a64e87dbc904 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.330014 May 10 14:17:44.711034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 125/251] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:44 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:44.715904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c5178ef-67f5-4747-aded-d47f38eb19df tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.326674 May 10 14:17:44.716507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 127/252] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:44 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:44.753986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:44.754637 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:44.760670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:44.761162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:44.761957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:44.762444 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:44.900654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:44.908676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1bdc2d2d-9228-4516-90bd-0b72019139d7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.159428 May 10 14:17:44.909291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 126/253] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:44 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:45.734278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:45.735334 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:45.738917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:45.739819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:45.750532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:45.751024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:45.751845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:45.752282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:45.757568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:45.758024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:45.761962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:45.761962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:46.002922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:46.010709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c9b1a9e-dec2-40cc-a4a0-1814d845fd87 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1367 microversion: 2.1 time: 0.280428 May 10 14:17:46.013966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 127/254] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:45 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:46.020152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:46.037118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3666c085-665f-4f17-9b6c-985983c25819 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.309121 May 10 14:17:46.037675 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 128/255] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:45 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:46.055381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:46.056259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:46.062460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:46.062902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:46.063678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:46.064154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:46.203015 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:46.210785 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-640d6a96-4936-4189-b24d-97ed549f2d56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.195617 May 10 14:17:46.211455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 128/256] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:46 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:47.031709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:47.033308 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:47.039451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.040015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.040902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.041340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.055411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:47.056086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:47.063477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.064360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.065643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.066144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.234638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:47.245274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2c6c769b-7290-48c1-919e-aa9352605559 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1557 microversion: 2.1 time: 0.217537 May 10 14:17:47.245893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 129/257] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:47 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:47.248902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:47.257988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7463b891-3d90-4416-a434-4b521d4e518d tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.206955 May 10 14:17:47.258940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 129/258] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:47 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:47.267430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:47.268180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:47.272432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6b1b46c-2e9e-43a7-8858-c58c1c372208 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:47.276308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6b1b46c-2e9e-43a7-8858-c58c1c372208 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:47.276439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.276439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.276439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.277100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.279931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b1b46c-2e9e-43a7-8858-c58c1c372208 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.280391 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b1b46c-2e9e-43a7-8858-c58c1c372208 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.281178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b1b46c-2e9e-43a7-8858-c58c1c372208 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:47.284011 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b1b46c-2e9e-43a7-8858-c58c1c372208 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:47.428157 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6b1b46c-2e9e-43a7-8858-c58c1c372208 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159609 May 10 14:17:47.430502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 130/259] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 10 14:17:47 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:17:47.603117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:47.610605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba286b6c-f4f0-4c84-9c72-282d1cfd1ec2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.363683 May 10 14:17:47.611404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 130/260] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:47 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:48.276206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:48.276807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:48.283967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:48.284652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:48.285467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:48.285899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:48.557960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:48.566553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c81ebe5-67a2-4aae-8f4f-cc791efc1139 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1313 microversion: 2.1 time: 0.294078 May 10 14:17:48.567147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 131/261] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:48 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:48.629757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:48.630697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:48.637779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:48.638364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:48.639236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:48.639921 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:48.971867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:48.981003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9300fc82-d4d1-4ee2-80e2-d31a4345b263 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.356753 May 10 14:17:48.986835 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 131/262] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:48 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:48.987238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:48.987733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:48.995894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:48.996479 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:48.997341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:48.998039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:49.027295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:17:49.227447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-c7c57e7f-b9b0-4041-924d-1456bf07d976 req-efb1f19e-e66f-43f0-9e81-a00f5daa4744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be793a1-f88b-4fb2-8e17-41545f3a5ee3", "tag": "583a709c-2a69-46cd-b56e-2731e7886ba1"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:49.239494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c7c57e7f-b9b0-4041-924d-1456bf07d976 req-efb1f19e-e66f-43f0-9e81-a00f5daa4744 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:49.240323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c7c57e7f-b9b0-4041-924d-1456bf07d976 req-efb1f19e-e66f-43f0-9e81-a00f5daa4744 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:49.275298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-c7c57e7f-b9b0-4041-924d-1456bf07d976 req-efb1f19e-e66f-43f0-9e81-a00f5daa4744 service nova] Creating event network-changed:583a709c-2a69-46cd-b56e-2731e7886ba1 for instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 on hv-cinder-84112 May 10 14:17:49.284738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-c7c57e7f-b9b0-4041-924d-1456bf07d976 req-efb1f19e-e66f-43f0-9e81-a00f5daa4744 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061791 May 10 14:17:49.295330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 132/263] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:17:49.526028 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f85f803c-15b5-4176-bd41-ab45afe2324f tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "DELETE /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 204 len: 0 microversion: 2.1 time: 0.542664 May 10 14:17:49.528287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 132/264] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:17:48 2022] DELETE /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:17:49.542756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:49.544190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:49.554328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:49.554856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:49.555756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:49.556297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:49.584596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:49.585437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:49.591875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:49.592335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:49.593119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:49.593729 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:49.749294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:49.760058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b33d2c1d-8f0f-46a0-9ec0-bc3a4c9b7a52 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1554 microversion: 2.1 time: 0.222842 May 10 14:17:49.763214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 133/265] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:49 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:49.787177 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:49.794578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba39d2ff-5313-413c-8076-560e6827c176 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1497 microversion: 2.1 time: 0.214486 May 10 14:17:49.795156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 133/266] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:49 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:49.999211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:49.999834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:50.007025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:50.007534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:50.008347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:50.008787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:50.234533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:50.244769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6e25f7ba-9da5-4d0b-a78a-06f36820b2b0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.249267 May 10 14:17:50.245862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 134/267] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:49 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:50.779207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:50.780012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:50.787078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:50.787836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:50.788615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:50.789046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:50.998305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:51.007490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46cef282-9953-4ce4-8145-763685eba0b2 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1554 microversion: 2.1 time: 0.232108 May 10 14:17:51.008276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 134/268] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:50 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1554 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:51.149389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:51.149922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:51.156593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:51.157166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:51.158969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:51.159492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:51.186080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:17:51.262463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:51.263017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:51.270492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:51.270595 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:51.271621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:51.272098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:51.403755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:51.411732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89e4c617-b1eb-4311-b0d5-90b5e13d1c56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.153513 May 10 14:17:51.418858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 135/269] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:51 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:51.520922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e9236761-d219-4db4-9bc9-1e9e82a4ea1e tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "DELETE /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 204 len: 0 microversion: 2.1 time: 0.375991 May 10 14:17:51.521413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 135/270] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:17:51 2022] DELETE /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:17:51.536897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:51.537507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:51.544373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:51.544850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:51.545700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:51.546385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:51.687417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:51.695931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-efa1d0ea-fb1b-4bee-83da-c714880268eb tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1503 microversion: 2.1 time: 0.164229 May 10 14:17:51.696502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 136/271] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:51 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:52.025766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:52.026519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:52.033082 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:52.033587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:52.034399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:52.034840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:52.210179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:52.218544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-09bf3329-4ace-4bfe-b63e-01d22cb383fc tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1554 microversion: 2.1 time: 0.197082 May 10 14:17:52.219112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 136/272] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:52 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:52.429564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:52.430226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:52.436219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:52.436660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:52.437449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:52.437875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:52.599329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:52.604567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4e0fe17-b6f7-4eec-8fb6-c09f788f3be2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.178871 May 10 14:17:52.605345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 137/273] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:52 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:52.714434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:52.715282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:52.727078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:52.727896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:52.728761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:52.729358 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:52.873636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:52.882580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-83c70842-124b-4871-97bd-689c55000224 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1503 microversion: 2.1 time: 0.172473 May 10 14:17:52.883355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 137/274] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:52 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:53.236066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:53.236582 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:53.242976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:53.243432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:53.244257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:53.244694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:53.378661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:53.387068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b3388836-a188-48da-990b-15c6aac95c59 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1554 microversion: 2.1 time: 0.154842 May 10 14:17:53.387635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 138/275] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:53 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:53.622514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:53.623117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:53.637418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:53.638100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:53.639206 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:53.639802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:53.786342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:53.793903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-59ff3612-5191-4b68-be50-0541da2cefab tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.175642 May 10 14:17:53.794561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 138/276] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:53 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:53.901349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:53.902159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:53.908845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:53.909337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:53.910111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:53.910602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:54.044759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:54.053072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dbcf8277-9b47-4820-893d-d09eaf2507fe tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1503 microversion: 2.1 time: 0.155994 May 10 14:17:54.053639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 139/277] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:53 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:54.405032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:54.406079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:54.413183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:54.413667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:54.414465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:54.414908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:54.551509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:54.559642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3b2a3fae-5e3e-4c4c-833c-49829a78f552 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1554 microversion: 2.1 time: 0.158626 May 10 14:17:54.560358 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 139/278] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:54 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:54.811800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:54.812775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:54.820360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:54.820948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:54.821966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:54.822456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:54.963680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:54.972398 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e44a380-17be-4ac4-9318-9600418d5dac tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.163726 May 10 14:17:54.973465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 140/279] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:54 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:55.079571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:55.080596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:55.091587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:55.092078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:55.095922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:55.097297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:55.310763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:55.319024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8fd976c8-41a2-424d-8e70-1a2345eb05be tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1503 microversion: 2.1 time: 0.252520 May 10 14:17:55.324897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 140/280] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:55 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:55.577065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:55.577785 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:55.584876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:55.591283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:55.591283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:55.591283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:55.652765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:55.661708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e900ab63-f836-4e8e-9abe-ded7298e4f6c tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1512 microversion: 2.1 time: 0.088742 May 10 14:17:55.663133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 141/281] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:55 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:55.724025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-be242db3-74b6-4190-85c4-e79928d0431b req-ec2fc867-f205-45ba-a010-c3ad7c97a940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58de3c26-b856-4d33-9880-9a5a94019241", "name": "network-vif-deleted", "tag": "f94ff5bb-e555-4366-b867-9c06734b0a39"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:55.734318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-be242db3-74b6-4190-85c4-e79928d0431b req-ec2fc867-f205-45ba-a010-c3ad7c97a940 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:55.734926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-be242db3-74b6-4190-85c4-e79928d0431b req-ec2fc867-f205-45ba-a010-c3ad7c97a940 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:55.748174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-be242db3-74b6-4190-85c4-e79928d0431b req-ec2fc867-f205-45ba-a010-c3ad7c97a940 service nova] Creating event network-vif-deleted:f94ff5bb-e555-4366-b867-9c06734b0a39 for instance 58de3c26-b856-4d33-9880-9a5a94019241 on hv-cinder-84112 May 10 14:17:55.754008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-be242db3-74b6-4190-85c4-e79928d0431b req-ec2fc867-f205-45ba-a010-c3ad7c97a940 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035698 May 10 14:17:55.754645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 141/282] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:55.990606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:55.992247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:56.000140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.001155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.003716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.004369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.173132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:56.181511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e59d74cc-9168-4bf9-9278-55daa1263ce1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.195908 May 10 14:17:56.191621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 142/283] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:55 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:56.337667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:56.338317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:56.344410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.345900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.345900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.346325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.378885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.379325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.379763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lazy-loading 'fault' on Instance uuid 58de3c26-b856-4d33-9880-9a5a94019241 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:17:56.426445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:56.434174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffbe4f35-8fd5-40bd-bd82-4d47c032b33c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 200 len: 1303 microversion: 2.1 time: 0.101289 May 10 14:17:56.434775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 142/284] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:56 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:56.679660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:56.680504 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:56.686400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.686856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.687706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.688045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.793661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00f343268134dea89e0a7070da14508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0f048425c440288655a28aecc12ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:56.818532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34b23676-2a5f-4993-b644-7d520f9c4fdd tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 200 len: 1345 microversion: 2.1 time: 0.142643 May 10 14:17:56.819228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 143/285] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:56 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 1345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:57.198756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:57.199372 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:57.205797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.206274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.207051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.207489 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.336487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:57.344299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-14ef3b01-4e64-4ae6-83e8-82f7e2616ef2 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.149406 May 10 14:17:57.344858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 143/286] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:57 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:57.453138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:57.453747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 58de3c26-b856-4d33-9880-9a5a94019241] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:57.459645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.460102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.460895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.461321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.474593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] HTTP exception thrown: Instance 58de3c26-b856-4d33-9880-9a5a94019241 could not be found. May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Request method failure captured: May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 HTTP/1.1 May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPi5LTELT6Qj8xvDfaT6LkpF5BTufYMPZsA0YjOLaR3Ffu1IPYgMX7tmIrF5wVSZ6__2pWnmZ9U3YdTEB4oSqPpPfzMVS494G3KY2jpJChgD1LIOtjGTl3fknNMWGszUmoDyr0MvmtOJey3L2rIEM6jyqj942MzAp1RiG08DUxz3A0 May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 2c1037d775114df4b21dbdfa5f639cb6 May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesActionsTest-1651077347 May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:17:57.479256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2c1037d775114df4b21dbdfa5f639cb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2c1037d775114df4b21dbdfa5f639cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2c1037d775114df4b21dbdfa5f639cb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2c1037d775114df4b21dbdfa5f639cb6"}]}] May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesActionsTest-1651077347 May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 2c1037d775114df4b21dbdfa5f639cb6 May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesActionsTest-1651077347 May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesActionsTest-1651077347-project May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 7669f2f83550428893d6c91614b78f76 May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesActionsTest-1651077347-project May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 58de3c26-b856-4d33-9880-9a5a94019241 could not be found. May 10 14:17:57.480654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '58de3c26-b856-4d33-9880-9a5a94019241'} May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58de3c26-b856-4d33-9880-9a5a94019241 could not be found. May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:17:57.481445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58de3c26-b856-4d33-9880-9a5a94019241 could not be found. May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58de3c26-b856-4d33-9880-9a5a94019241 could not be found. May 10 14:17:57.482578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.483545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Returning 404 to user: Instance 58de3c26-b856-4d33-9880-9a5a94019241 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:17:57.483545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92e320d2-89b1-45dd-9c44-4eb3179f3929 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241" status: 404 len: 111 microversion: 2.1 time: 0.031656 May 10 14:17:57.483545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 144/287] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:57 2022] GET /compute/v2.1/servers/58de3c26-b856-4d33-9880-9a5a94019241 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:17:57.585978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1989701227", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "networks": [{"uuid": "ae79f6cb-f6c2-4f23-a0e0-b4ae12d2b434"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:57.636770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] validate_networks() for [('ae79f6cb-f6c2-4f23-a0e0-b4ae12d2b434', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:17:57.767904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-407e5983-839b-4ed5-8769-7d68462428ce req-8b844c2f-00a2-46d4-8b93-1ea8ac95a33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dfc192-c4f0-4f6b-8b06-70c5d807b5eb", "name": "network-vif-deleted", "tag": "8109ea46-9ac9-42cd-bd4b-19706888d99e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:57.776347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-407e5983-839b-4ed5-8769-7d68462428ce req-8b844c2f-00a2-46d4-8b93-1ea8ac95a33a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.778023 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-407e5983-839b-4ed5-8769-7d68462428ce req-8b844c2f-00a2-46d4-8b93-1ea8ac95a33a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.790471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-407e5983-839b-4ed5-8769-7d68462428ce req-8b844c2f-00a2-46d4-8b93-1ea8ac95a33a service nova] Creating event network-vif-deleted:8109ea46-9ac9-42cd-bd4b-19706888d99e for instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb on hv-cinder-84112 May 10 14:17:57.796354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-407e5983-839b-4ed5-8769-7d68462428ce req-8b844c2f-00a2-46d4-8b93-1ea8ac95a33a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 May 10 14:17:57.796955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 145/288] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:17:57.858262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:57.858262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:57.858262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.858262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.858917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.858917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.858917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] HTTP exception thrown: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Request method failure captured: May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb HTTP/1.1 May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienO-kKSCuUBfkXSSGsWjSzxPCiet2oCak3aJQFJ1BAJbHSgxqNRsptgeYSdcKkliSWfikAAqzkaKHuc3ooqg9XyxQdeYC7sPj7IA6hD7hTqkpL03X8gblSJaVDDt4EaxY963xTtcnbKHgbfDl31gRrUQCBI9URvEBWGylkpJYroPFbQ May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:17:57.860268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e0f048425c440288655a28aecc12ce5"}]}] May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: f00f343268134dea89e0a7070da14508 May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.861855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '30dfc192-c4f0-4f6b-8b06-70c5d807b5eb'} May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:17:57.862784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.863985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.864921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Returning 404 to user: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:17:57.864921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2fdffe7a-172d-43d6-b550-66453b191aa3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 404 len: 111 microversion: 2.1 time: 0.029904 May 10 14:17:57.864921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 146/289] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:57 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:17:57.966751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:57.967810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:57.974356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.978630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.978630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.978630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.989969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] HTTP exception thrown: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.991950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Request method failure captured: May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb/os-volume_attachments HTTP/1.1 May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienO-kKSCuUBfkXSSGsWjSzxPCiet2oCak3aJQFJ1BAJbHSgxqNRsptgeYSdcKkliSWfikAAqzkaKHuc3ooqg9XyxQdeYC7sPj7IA6hD7hTqkpL03X8gblSJaVDDt4EaxY963xTtcnbKHgbfDl31gRrUQCBI9URvEBWGylkpJYroPFbQ May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:17:57.992079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e0f048425c440288655a28aecc12ce5"}]}] May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: f00f343268134dea89e0a7070da14508 May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.993196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '30dfc192-c4f0-4f6b-8b06-70c5d807b5eb'} May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:17:57.993831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:57.994878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:17:57.995927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:17:57.996002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Returning 404 to user: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:17:57.996080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:17:57.996151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a69dfbed-90f3-4356-a69d-128b653d5391 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030713 May 10 14:17:57.996230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:17:57.996301 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 147/290] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:17:57 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:17:57.997407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:17:58.007575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:58.008026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:58.009131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:58.009613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:58.028212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Getting quotas for project 2c1037d775114df4b21dbdfa5f639cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:17:58.036497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Getting quotas for user 7669f2f83550428893d6c91614b78f76 and project 2c1037d775114df4b21dbdfa5f639cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:17:58.050782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:17:58.053085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:17:58.167877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aad24172-a2e7-41af-bbe8-b5765b0e3593 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585662 May 10 14:17:58.168605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 144/291] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:17:58.179721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-930b5edf-cecc-4016-906e-3b3a47585a6a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:58.180558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-930b5edf-cecc-4016-906e-3b3a47585a6a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:58.239218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-930b5edf-cecc-4016-906e-3b3a47585a6a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:58.245809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-930b5edf-cecc-4016-906e-3b3a47585a6a tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1214 microversion: 2.1 time: 0.070469 May 10 14:17:58.246556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 148/292] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:58 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:58.360695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:58.362367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:58.368235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:58.368614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:58.369372 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:58.369795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:58.499980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:58.507834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aeb32625-7d62-4466-92bd-cb15e5a5efd7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.151392 May 10 14:17:58.508406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 145/293] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:58 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:58.920614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1751725673", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "networks": [{"uuid": "f2ec8871-40d2-4900-a07b-6b81ad4c336e"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:58.973372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] validate_networks() for [('f2ec8871-40d2-4900-a07b-6b81ad4c336e', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:17:59.264366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:59.265462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:59.273797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.274535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.275454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.276166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.353282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:59.355780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:17:59.356779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:17:59.357602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:17:59.359934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:17:59.360559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:17:59.366336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cb5b7e2c-f6ee-4f6d-b375-ecd9935f3646 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1218 microversion: 2.1 time: 0.106341 May 10 14:17:59.370540 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 146/294] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:59 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:59.373130 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.373893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.374892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.375866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.376293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:59.377034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:59.383481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.384137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.384987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.385483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.395972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Getting quotas for project 709b9712f09a42a785d046e0c0f3846e. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:17:59.400009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] HTTP exception thrown: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.400135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Getting quotas for user 48efa16cb9844fcd853f1e3760619a66 and project 709b9712f09a42a785d046e0c0f3846e. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Request method failure captured: May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb HTTP/1.1 May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienO-kKSCuUBfkXSSGsWjSzxPCiet2oCak3aJQFJ1BAJbHSgxqNRsptgeYSdcKkliSWfikAAqzkaKHuc3ooqg9XyxQdeYC7sPj7IA6hD7hTqkpL03X8gblSJaVDDt4EaxY963xTtcnbKHgbfDl31gRrUQCBI9URvEBWGylkpJYroPFbQ May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:17:59.404808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e0f048425c440288655a28aecc12ce5"}]}] May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: f00f343268134dea89e0a7070da14508 May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.406416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '30dfc192-c4f0-4f6b-8b06-70c5d807b5eb'} May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:17:59.407113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.409060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.410298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Returning 404 to user: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:17:59.410298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07d23e30-b7da-465e-927a-ae8cc1a7c073 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "DELETE /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 404 len: 111 microversion: 2.1 time: 0.034910 May 10 14:17:59.410298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 147/295] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:17:59 2022] DELETE /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:17:59.413588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:17:59.417901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:17:59.418243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:59.418865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] [instance: 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:59.427625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.428073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.428896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.429333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.450185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] HTTP exception thrown: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Request method failure captured: May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb HTTP/1.1 May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienO-kKSCuUBfkXSSGsWjSzxPCiet2oCak3aJQFJ1BAJbHSgxqNRsptgeYSdcKkliSWfikAAqzkaKHuc3ooqg9XyxQdeYC7sPj7IA6hD7hTqkpL03X8gblSJaVDDt4EaxY963xTtcnbKHgbfDl31gRrUQCBI9URvEBWGylkpJYroPFbQ May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:17:59.452768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e0f048425c440288655a28aecc12ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e0f048425c440288655a28aecc12ce5"}]}] May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 6e0f048425c440288655a28aecc12ce5 May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025847537 May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: f00f343268134dea89e0a7070da14508 May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-DeleteServersTestJSON-2025847537-project May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.453998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '30dfc192-c4f0-4f6b-8b06-70c5d807b5eb'} May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:17:59.454690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. May 10 14:17:59.455746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:17:59.456695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] Returning 404 to user: Instance 30dfc192-c4f0-4f6b-8b06-70c5d807b5eb could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:17:59.457850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c011c0c-e386-45ea-9b98-b7d5e2b6cbf3 tempest-DeleteServersTestJSON-2025847537 tempest-DeleteServersTestJSON-2025847537-project] 10.222.0.58 "GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb" status: 404 len: 111 microversion: 2.1 time: 0.044915 May 10 14:17:59.458862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 148/296] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:59 2022] GET /compute/v2.1/servers/30dfc192-c4f0-4f6b-8b06-70c5d807b5eb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:17:59.525586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:59.535019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:59.535019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.535019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.535019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.535448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.584861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e44a878d-54cd-4d5c-bd60-6fa8050ca14d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668000 May 10 14:17:59.586150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 149/297] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:17:59.596469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-766713e6-01e4-48b3-8756-adb817618c6c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:59.597084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-766713e6-01e4-48b3-8756-adb817618c6c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:59.696511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-766713e6-01e4-48b3-8756-adb817618c6c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:59.706170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-766713e6-01e4-48b3-8756-adb817618c6c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1219 microversion: 2.1 time: 0.112994 May 10 14:17:59.707651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 150/298] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:59 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:59.749131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:59.760969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fd7a6fca-59ae-430e-a0b2-4f161e0de9dd tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.239843 May 10 14:17:59.761763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 149/299] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:17:59 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:00.391413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:00.392016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:00.398620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:00.399070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:00.399839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:00.400271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:00.461197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:00.468430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40705f05-38da-4bdc-b4f5-28694082a3b6 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1266 microversion: 2.1 time: 0.080930 May 10 14:18:00.469031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 151/300] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:00 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:00.724693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b9a00a64-617d-467e-99c3-008c05fcda3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:00.725309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b9a00a64-617d-467e-99c3-008c05fcda3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:00.777113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b9a00a64-617d-467e-99c3-008c05fcda3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:00.779374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:00.786871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:00.787003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b9a00a64-617d-467e-99c3-008c05fcda3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1219 microversion: 2.1 time: 0.064438 May 10 14:18:00.787003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 150/301] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:00 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:00.787419 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:00.787986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:00.788859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:00.789389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:00.933425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:00.941648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e0da1af-4c45-49bf-938a-3aa54fa26cd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.166233 May 10 14:18:00.942245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 152/302] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:00 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:01.487075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:01.487698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:01.497043 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.499254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:01.499254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.499254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:01.650566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:01.658794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6835558c-a471-45cc-90c7-88b9418d1330 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.174989 May 10 14:18:01.659366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 151/303] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:01 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:01.802742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:01.803543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:01.810022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.810693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:01.811494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.811854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:01.875189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:01.889063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e9cac10-357d-47c1-aeb6-9d57d1ec9964 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1223 microversion: 2.1 time: 0.089147 May 10 14:18:01.889063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 153/304] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:01 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:01.959309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:01.960555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:01.967511 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.968163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:01.969172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.969764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.129703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:02.140271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-99315db9-5961-4483-862c-932f1e0c9e20 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.185467 May 10 14:18:02.140848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 152/305] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:01 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:02.607147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-05a6c967-bdc7-4b0f-89de-87fbc406a9aa req-ff630440-54fe-41a4-a3a4-13fdf44d993b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a7ed412-4d4b-4cc3-ae31-07430a61b206", "tag": "96cb7381-e819-48af-8600-535ac9d752fd"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:02.632535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-05a6c967-bdc7-4b0f-89de-87fbc406a9aa req-ff630440-54fe-41a4-a3a4-13fdf44d993b service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:02.633318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-05a6c967-bdc7-4b0f-89de-87fbc406a9aa req-ff630440-54fe-41a4-a3a4-13fdf44d993b service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.646700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-05a6c967-bdc7-4b0f-89de-87fbc406a9aa req-ff630440-54fe-41a4-a3a4-13fdf44d993b service nova] Creating event network-changed:96cb7381-e819-48af-8600-535ac9d752fd for instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 on hv-cinder-84112 May 10 14:18:02.652304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-05a6c967-bdc7-4b0f-89de-87fbc406a9aa req-ff630440-54fe-41a4-a3a4-13fdf44d993b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048496 May 10 14:18:02.654410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 154/306] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:18:02.677598 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:02.678334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:02.684191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:02.684901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.685641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:02.686074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.835025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:02.847163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-456126dc-2c29-4a6c-8b67-7640bf36ad93 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.174063 May 10 14:18:02.861376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 153/307] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:02 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:02.908165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:02.909806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:02.919571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:02.920964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.922041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:02.922749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.997371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:03.008990 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a4627e0-fcc0-48d4-ad76-6c9430a12c7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1279 microversion: 2.1 time: 0.107895 May 10 14:18:03.010238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 155/308] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:02 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:03.157191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:03.157957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:03.170248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:03.171126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:03.172048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:03.172490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:03.313841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:03.323080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1f701ee3-cb68-4ca2-b3b9-8ac2a3dd9522 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.169193 May 10 14:18:03.336895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 154/309] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:03 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:03.867466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:03.868078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:03.874122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:03.874617 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:03.875405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:03.875845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:04.031364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:04.032053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:04.032541 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:04.041188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:04.041824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd98a2e8-3016-4aea-ac00-3a8bc37d83e1 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.178418 May 10 14:18:04.042296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 156/310] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:03 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:04.051846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:04.051846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:04.051846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:04.207544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:04.215496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c9a3d6f6-4594-4f5c-b594-ab742104ed4d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.190882 May 10 14:18:04.216069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 155/311] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:04 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:04.342047 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:04.342676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:04.349709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:04.350188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:04.351031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:04.351488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:04.487689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:04.495209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c0883ea-dba0-4d21-9ddc-5d51ccf263ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.157321 May 10 14:18:04.495771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 157/312] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:04 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:05.059129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:05.059872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:05.065886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:05.066418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:05.067186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:05.067617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:05.200530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:05.208605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a1301dd1-d06c-4202-8dc3-63c120be5825 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.153413 May 10 14:18:05.209293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 156/313] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:05 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:05.234095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:05.235382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:05.241466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:05.241910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:05.242706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:05.243139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:05.375983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:05.384392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9782913d-a0eb-4dff-8eb4-7a4755cd0a14 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.154116 May 10 14:18:05.384968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 158/314] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:05 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:05.512058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:05.512671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:05.518996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:05.519443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:05.520207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:05.520640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:05.650877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:05.659423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a040bb49-5170-4679-85a1-a392962e2679 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.151329 May 10 14:18:05.659992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 157/315] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:05 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:06.226338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:06.226903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:06.232864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.233318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.237053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.237053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.374719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:06.383085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d443269-2b2d-474a-8396-164dcdca7700 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.160631 May 10 14:18:06.383761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 159/316] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:06 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:06.405519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:06.406219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:06.413630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.414076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.414878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.415313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.545914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:06.553412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-49696ed9-8307-4efa-a6be-4de3bfa5fd0f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.151747 May 10 14:18:06.553980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 158/317] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:06 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:06.677469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:06.677974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:06.684302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.684795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.686169 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.686865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.823441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:06.832465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-638067e5-17e6-4845-a006-7a71c64f0e7e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.159971 May 10 14:18:06.833052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 160/318] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:06 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:07.350839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-1eaba4e7-251a-4f3f-8caa-7a245547ce03 req-f7c37d64-7da5-4b16-8a9c-dc3c15ad48e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ab87ed-87c5-4255-8a75-6e5add1c4ce0", "tag": "ad53262e-0d17-48e0-a428-2a9c5dea914e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:07.360008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1eaba4e7-251a-4f3f-8caa-7a245547ce03 req-f7c37d64-7da5-4b16-8a9c-dc3c15ad48e0 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.360457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1eaba4e7-251a-4f3f-8caa-7a245547ce03 req-f7c37d64-7da5-4b16-8a9c-dc3c15ad48e0 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.371919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-1eaba4e7-251a-4f3f-8caa-7a245547ce03 req-f7c37d64-7da5-4b16-8a9c-dc3c15ad48e0 service nova] Creating event network-changed:ad53262e-0d17-48e0-a428-2a9c5dea914e for instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 on hv-cinder-84112 May 10 14:18:07.377195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-1eaba4e7-251a-4f3f-8caa-7a245547ce03 req-f7c37d64-7da5-4b16-8a9c-dc3c15ad48e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029627 May 10 14:18:07.377804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 159/319] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:07.400626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:07.401240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:07.407059 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.407508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.408285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.409064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.539140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:07.546471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7250fb7c-606b-40e0-a652-b81efb17bb59 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.149655 May 10 14:18:07.547065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 161/320] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:07 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:07.571675 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:07.572440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:07.578487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.578986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.579817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.580456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.723351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:07.730913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b61b5b9e-07d9-4600-9c86-e3f9edd7e18b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.164053 May 10 14:18:07.731820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 160/321] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:07 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:07.849667 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:07.850304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:07.856238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.856688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.857526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.857968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.984837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:07.992991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e8254104-703d-4f13-94f4-85c9a0ddfd65 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.147772 May 10 14:18:07.993570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 162/322] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:07 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:08.563467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:08.564177 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:08.571240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:08.571684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:08.572441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:08.572988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:08.748113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:08.748702 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:08.755470 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:08.755910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:08.756714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:08.757138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:08.988057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:08.996836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-890ee8f4-8d23-474d-8ebb-37b14f17e441 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.437095 May 10 14:18:08.997603 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 161/323] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:08 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:09.000158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:09.009126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95fc5ae7-d93b-49de-b958-9d4bbe8901a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.265005 May 10 14:18:09.009410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:09.009869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 163/324] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:08 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:09.010249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:09.016186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:09.016639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:09.017479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:09.017947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:09.163406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:09.170763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b7f3d3a6-1491-49af-9bbc-5a5394fda112 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.165093 May 10 14:18:09.171362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 162/325] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:09 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:10.013601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:10.014243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:10.020313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.020762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.021528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.022115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.025110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:10.025752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:10.032125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.032571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.033353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.034306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.219456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:10.221592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:10.227808 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e22c21e0-4147-4477-bca2-f76c18efa678 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.217980 May 10 14:18:10.228468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 164/326] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:10 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:10.229660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ae2e981-f783-4b56-ad65-5c80916d9b95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.208350 May 10 14:18:10.230691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 163/327] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:10 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:10.233468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:10.234132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:10.241211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.241658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.242446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.242875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.302164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-25b9d522-7119-41ff-af92-2968fae9f88c req-91a1338f-eb0b-4acc-8033-1c9fc0e33122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7ed412-4d4b-4cc3-ae31-07430a61b206", "name": "network-vif-plugged", "status": "completed", "tag": "96cb7381-e819-48af-8600-535ac9d752fd"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:10.315140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-25b9d522-7119-41ff-af92-2968fae9f88c req-91a1338f-eb0b-4acc-8033-1c9fc0e33122 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.315856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-25b9d522-7119-41ff-af92-2968fae9f88c req-91a1338f-eb0b-4acc-8033-1c9fc0e33122 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.329401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-25b9d522-7119-41ff-af92-2968fae9f88c req-91a1338f-eb0b-4acc-8033-1c9fc0e33122 service nova] Creating event network-vif-plugged:96cb7381-e819-48af-8600-535ac9d752fd for instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 on hv-cinder-84112 May 10 14:18:10.335583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-25b9d522-7119-41ff-af92-2968fae9f88c req-91a1338f-eb0b-4acc-8033-1c9fc0e33122 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040822 May 10 14:18:10.336415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 164/328] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:18:10.386891 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:10.394945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f04ecca-41b5-441d-bffc-fa24d4ae30e0 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1520 microversion: 2.1 time: 0.165152 May 10 14:18:10.395662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 165/329] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:10 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:11.248342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:11.249330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:11.254607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:11.255391 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:11.257024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.257470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.258292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.258725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.261401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.261909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.262766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.263246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.455618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:11.459638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:11.463943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-134ab357-9a80-4bf3-9425-ef8682ee6196 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.220104 May 10 14:18:11.464608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 165/330] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:11 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:11.469465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:11.470344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:11.476551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35772642-2a52-4523-b0a7-be6c2d2f30c9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.226313 May 10 14:18:11.477803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 166/331] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:11 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:11.478743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.479205 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.480049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.480494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.622037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:11.633332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5fbd0e39-5731-4353-b45b-aeafcf71d33c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1500 microversion: 2.1 time: 0.167425 May 10 14:18:11.633967 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 166/332] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:11 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:11.654344 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:11.654956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:11.662108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.662606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.663381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.663819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.798772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:11.806740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b790f373-ae94-40d8-9640-2718eb3878d4 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1516 microversion: 2.1 time: 0.156110 May 10 14:18:11.807308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 167/333] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:11 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:12.481301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:12.482028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:12.489751 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:12.490624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:12.491063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:12.491503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:12.493455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:12.494059 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:12.500057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:12.500496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:12.501259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:12.501692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:12.694548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:12.701969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:12.702329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8fc22bb6-b92b-451c-b6b5-d5453510312c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.225188 May 10 14:18:12.703109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 167/334] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:12 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:12.710793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59053000-5865-4bb6-b4e3-015a9c07b934 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.221209 May 10 14:18:12.711441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 168/335] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:12 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:13.720865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:13.721801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:13.728294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:13.728477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:13.728884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:13.728979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:13.729509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:13.729943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:13.734728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:13.735296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:13.735968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:13.737466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:13.921949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:13.930482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-245693ad-cded-41c2-b1f2-f9e8f3baf26c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.213791 May 10 14:18:13.931380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 168/336] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:13 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:13.934973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:13.943138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4edcea03-5099-4872-9e00-fb95831bd0bd tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.218637 May 10 14:18:13.943938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 169/337] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:13 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:14.572333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:14.573559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:14.581726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.582286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.583168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.583680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.610294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lazy-loading 'flavor' on Instance uuid 0a8bc09f-ec85-4865-93b7-28628f5b8797 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:18:14.908953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e005b5a6-57de-4d39-b8ce-8ec2ee5faa4f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797/action" status: 200 len: 32 microversion: 2.1 time: 0.339414 May 10 14:18:14.908953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 169/338] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:18:14 2022] POST /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:18:14.918380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:14.918982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:14.926166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.926644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.927415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.927849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.950532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:14.951431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:14.962787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.963285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.964255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.964683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:15.128385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:15.144894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ed46f46-e3a6-46d4-a606-1074972d896e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.230325 May 10 14:18:15.145792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 170/339] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:14 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:15.152691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:15.153237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:15.153567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:15.163661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:15.164241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:15.165002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3430079b-1e41-44f9-9a50-1a4cc14d3982 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.219434 May 10 14:18:15.165294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:15.166410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:15.176248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 170/340] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:14 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:15.320317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:15.331646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3a2075a6-9518-4b6c-8275-b3a23d1c64a0 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.183315 May 10 14:18:15.332464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 171/341] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:15 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:16.164194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:16.165002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:16.171677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.172128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.172909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.173337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.186373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:16.186956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:16.193330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.194170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.195164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.195882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.365601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:16.375610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8d15dc4b-8b32-468c-bcae-33fa5ae704d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.215238 May 10 14:18:16.376191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 171/342] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:16 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:16.381483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:16.382323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:16.388505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.389222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.390119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.390672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.402751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:16.410153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a714413c-527e-4bf7-8edf-9d6c5c1ee1fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.230916 May 10 14:18:16.410746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 172/343] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:16 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:16.560242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:16.572237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-736b8649-1bdd-4830-81d9-b7bc2452e311 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1314 microversion: 2.1 time: 0.194486 May 10 14:18:16.572809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 172/344] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:16 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:17.393214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:17.394520 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:17.400708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:17.401150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:17.401924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:17.402395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:17.428127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:17.429405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:17.435709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:17.436406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:17.437340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:17.437932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:17.600936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:17.608661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c22aa1e7-317a-4a2a-898d-4a79df030755 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.219518 May 10 14:18:17.619126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 173/345] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:17 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:17.621623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:17.623835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:17.624431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:17.629288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48b5e01c-df26-4f90-9b82-5e5be0c35e63 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.206492 May 10 14:18:17.629832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 173/346] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:17 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:17.630168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:17.630670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:17.631462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:17.631895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:17.768505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:17.776164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f000db1-e619-4722-9033-e45491f772e9 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1498 microversion: 2.1 time: 0.155989 May 10 14:18:17.777055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 174/347] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:17 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:18.628111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:18.629498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:18.630095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-175e52dd-bcc8-4f14-ac3a-d11b74131c8f req-e2c24add-b7f3-4150-b451-b1f611b91fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ab87ed-87c5-4255-8a75-6e5add1c4ce0", "name": "network-vif-plugged", "status": "completed", "tag": "ad53262e-0d17-48e0-a428-2a9c5dea914e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:18.639576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-175e52dd-bcc8-4f14-ac3a-d11b74131c8f req-e2c24add-b7f3-4150-b451-b1f611b91fcf service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:18.643141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-175e52dd-bcc8-4f14-ac3a-d11b74131c8f req-e2c24add-b7f3-4150-b451-b1f611b91fcf service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:18.643309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:18.646119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:18.646955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:18.647684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:18.652941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-175e52dd-bcc8-4f14-ac3a-d11b74131c8f req-e2c24add-b7f3-4150-b451-b1f611b91fcf service nova] Creating event network-vif-plugged:ad53262e-0d17-48e0-a428-2a9c5dea914e for instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 on hv-cinder-84112 May 10 14:18:18.658555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-175e52dd-bcc8-4f14-ac3a-d11b74131c8f req-e2c24add-b7f3-4150-b451-b1f611b91fcf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 May 10 14:18:18.659852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 175/348] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:18:18.665016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:18.665711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:18.671770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:18.672400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:18.673381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:18.674835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:18.920388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:18.924787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:18.929572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c649e38-a341-4506-9295-00630c8bb31a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.307436 May 10 14:18:18.930342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 174/349] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:18 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:18.935188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:18.936130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:18.937252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2878f028-db8c-4d26-9727-bdf87e8c085b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.276143 May 10 14:18:18.937826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 176/350] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:18 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:18.943649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:18.944108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:18.945016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:18.945324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:18.982729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:18:19.217373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-17567daf-fff4-4c19-b70d-dfc2e33b5800 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 204 len: 0 microversion: 2.1 time: 0.285641 May 10 14:18:19.218081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 175/351] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:18:18 2022] DELETE /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:18:19.228389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:19.229007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:19.235425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:19.236053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:19.237132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:19.237573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:19.371573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:19.380782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a27b7384-c545-430f-a476-434c6444478c tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1504 microversion: 2.1 time: 0.157540 May 10 14:18:19.381718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 177/352] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:19 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:19.948735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:19.949470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:19.954441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:19.957068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:19.957456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:19.957911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:19.958711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:19.959146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:19.972112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:19.972663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:19.975183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:19.975689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:20.199491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:20.207213 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-24dccd9d-b49e-4f87-beb5-b875cec25be8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.263183 May 10 14:18:20.207790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 176/353] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:19 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:20.231801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:20.240035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25726134-f977-46d8-9c45-a4a16236cf36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.289419 May 10 14:18:20.240609 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 178/354] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:19 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:20.404807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:20.405630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:20.413931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:20.414425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:20.415393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:20.415830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:20.551161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:20.559377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7bd89878-db7c-4d67-8431-a1a271c8e22f tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1504 microversion: 2.1 time: 0.159049 May 10 14:18:20.559871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 177/355] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:20 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:21.224868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:21.226325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:21.232446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:21.233076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:21.233848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:21.234455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:21.258426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:21.259656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:21.265844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:21.266504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:21.268224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:21.269364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:21.480269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:21.488180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f4f79bf-26a4-4674-b9ee-3bd6f924d6c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.267785 May 10 14:18:21.488750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 179/356] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:21 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:21.492289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:21.499565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-207efc52-addc-40f8-94e4-965d1b06348b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1319 microversion: 2.1 time: 0.246192 May 10 14:18:21.500179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 178/357] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:21 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:21.576678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:21.577266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:21.583883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:21.584395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:21.585347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:21.585780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:21.737155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:21.744917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-600d6478-0f2d-4cd6-b754-c5fd07c6f143 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1504 microversion: 2.1 time: 0.172136 May 10 14:18:21.745470 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 180/358] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:21 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:22.329930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-c64216b2-660f-43b9-a122-a5f6f8c878be req-46f00fa8-cf40-4d36-bbb4-8fd9f2b6a77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7ed412-4d4b-4cc3-ae31-07430a61b206", "name": "network-vif-deleted", "tag": "96cb7381-e819-48af-8600-535ac9d752fd"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:22.339959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c64216b2-660f-43b9-a122-a5f6f8c878be req-46f00fa8-cf40-4d36-bbb4-8fd9f2b6a77a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:22.340410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c64216b2-660f-43b9-a122-a5f6f8c878be req-46f00fa8-cf40-4d36-bbb4-8fd9f2b6a77a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:22.351973 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-c64216b2-660f-43b9-a122-a5f6f8c878be req-46f00fa8-cf40-4d36-bbb4-8fd9f2b6a77a service nova] Creating event network-vif-deleted:96cb7381-e819-48af-8600-535ac9d752fd for instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 on hv-cinder-84112 May 10 14:18:22.356939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-c64216b2-660f-43b9-a122-a5f6f8c878be req-46f00fa8-cf40-4d36-bbb4-8fd9f2b6a77a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030786 May 10 14:18:22.357539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 179/359] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:22.506327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:22.506928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:22.512852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:22.513334 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:22.514095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:22.514553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:22.517210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:22.518794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:22.526561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:22.526561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:22.526561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:22.526561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:22.762360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:22.765208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:22.772107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97950afe-81bd-4bf9-a8bb-feb740ae995c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.270843 May 10 14:18:22.772743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 181/360] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:22 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:22.773111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-393ffd16-40ed-454f-b993-3471829aa751 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1509 microversion: 2.1 time: 0.259939 May 10 14:18:22.773682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 180/361] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:22 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:22.777405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:22.778155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:22.785039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:22.785686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:22.786725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:22.787704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:22.854276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7669f2f83550428893d6c91614b78f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1037d775114df4b21dbdfa5f639cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:22.862501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f4d5963-e8a6-461d-bfd6-74b683d01c0b tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 200 len: 1299 microversion: 2.1 time: 0.088463 May 10 14:18:22.866818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 182/362] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:22 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:23.790554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:23.791370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:23.798362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:23.799436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:23.800630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:23.801164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:23.880140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:23.880548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] [instance: 1a7ed412-4d4b-4cc3-ae31-07430a61b206] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:23.886281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:23.886795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:23.888306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:23.888799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:23.903393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] HTTP exception thrown: Instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 could not be found. May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Request method failure captured: May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 HTTP/1.1 May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPi5LTELT6Qj8xvDfaT6LkpF5BTufYMPZsA0YjOLaR3Ffu1IPYgMX7tmIrF5wVSZ6__2pWnmZ9U3YdTEB4oSqPpPfzMVS494G3KY2jpJChgD1LIOtjGTl3fknNMWGszUmoDyr0MvmtOJey3L2rIEM6jyqj942MzAp1RiG08DUxz3A0 May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 2c1037d775114df4b21dbdfa5f639cb6 May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesActionsTest-1651077347 May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:18:23.905684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2c1037d775114df4b21dbdfa5f639cb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2c1037d775114df4b21dbdfa5f639cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2c1037d775114df4b21dbdfa5f639cb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2c1037d775114df4b21dbdfa5f639cb6"}]}] May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesActionsTest-1651077347 May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 2c1037d775114df4b21dbdfa5f639cb6 May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesActionsTest-1651077347 May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesActionsTest-1651077347-project May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 7669f2f83550428893d6c91614b78f76 May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesActionsTest-1651077347-project May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 could not be found. May 10 14:18:23.907146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '1a7ed412-4d4b-4cc3-ae31-07430a61b206'} May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 could not be found. May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:18:23.907947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 could not be found. May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 could not be found. May 10 14:18:23.910233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:23.912445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] Returning 404 to user: Instance 1a7ed412-4d4b-4cc3-ae31-07430a61b206 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:18:23.913467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90fa6649-20d4-4bea-b8ce-329a9914dd05 tempest-VolumesActionsTest-1651077347 tempest-VolumesActionsTest-1651077347-project] 10.222.0.58 "GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206" status: 404 len: 111 microversion: 2.1 time: 0.038324 May 10 14:18:23.914025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 183/363] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:23 2022] GET /compute/v2.1/servers/1a7ed412-4d4b-4cc3-ae31-07430a61b206 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:18:23.937260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:23.945399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-90cb5ca4-13d1-461f-9014-1841f36b4943 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.159301 May 10 14:18:23.945968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 181/364] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:23 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:24.962807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:24.963417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:24.969275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:24.969757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:24.970560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:24.971764 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:25.110697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:25.119849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2cce2eb-9046-4db1-95e0-e896bc3c7c8a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.160918 May 10 14:18:25.120448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 184/365] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:24 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:26.136826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:26.137436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:26.144494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:26.144938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:26.145707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:26.146144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:26.282165 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:26.290253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2b73ab54-b797-46dc-be11-77263ab9f666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.157323 May 10 14:18:26.291069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 182/366] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:26 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:27.308167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:27.308829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:27.315272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:27.315709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:27.316733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:27.317162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:27.444094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:27.453145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8c14a6f-cdd0-49f7-8cf3-cd6e1f6d8c8e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.148748 May 10 14:18:27.453711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 185/367] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:27 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:28.470488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:28.472038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:28.478505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:28.478948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:28.479705 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:28.480133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:28.612994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:28.620937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4d205ceb-78bd-4b7f-93e1-588c805bc1d9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.154216 May 10 14:18:28.621562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 183/368] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:28 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:29.638351 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:29.638968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:29.645225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:29.645694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:29.646557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:29.646984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:29.774912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:29.782107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc4cf733-1178-4720-8b62-ec140b9a404a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.147639 May 10 14:18:29.782693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 186/369] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:29 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:30.799949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:30.800549 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:30.807089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:30.807554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:30.808332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:30.808784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:30.956280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:30.964445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-087085d4-2c70-4f99-a4f8-61f34bcede8b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.168676 May 10 14:18:30.974385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 184/370] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:30 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:31.980929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:31.981493 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:31.988188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:31.988627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:31.989394 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:31.989821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:32.126932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:32.135350 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a3584ae-575e-4bab-9dc0-08bd83f94b3b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.158345 May 10 14:18:32.135911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 187/371] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:31 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:33.152772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:33.153377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:33.161380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:33.161959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:33.162762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:33.163203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:33.298041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:33.306557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d4026f8c-aa73-4b4a-921a-0bfcf83e8a3d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.157557 May 10 14:18:33.307122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 185/372] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:33 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:34.324319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:34.325018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:34.330917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:34.331370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:34.332143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:34.332646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:34.465201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:34.472580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7c0b8e3-5cc8-434d-bb79-05957583caee tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.152086 May 10 14:18:34.473143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 188/373] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:34 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:35.489702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:35.490292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:35.496546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:35.496999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:35.497771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:35.498237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:35.629070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:35.636878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8b26c290-8321-4a07-95c9-1f20468f064c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.151765 May 10 14:18:35.637447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 186/374] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:35 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:36.654920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:36.655658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:36.662498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:36.662940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:36.663702 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:36.664178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:36.805954 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:36.814063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2173b300-2dbd-479c-b1dd-18a8313ecc05 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.163027 May 10 14:18:36.814959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 189/375] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:36 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:37.832313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:37.832942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:37.839192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:37.839637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:37.840391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:37.840821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:37.967087 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:37.975102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c84ff43-6e12-402f-b6e5-10dce463dcdb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.147094 May 10 14:18:37.975588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 187/376] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:37 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:38.992285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:38.992888 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:38.999350 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:38.999802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:39.000589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:39.001021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:39.135835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:39.143875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5fb089a-34c2-4b14-b0f7-17cca64547c3 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.154786 May 10 14:18:39.144416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 190/377] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:38 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:40.162599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:40.163296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:40.169719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:40.170164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:40.170949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:40.171377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:40.303743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:40.315565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fc1e8f8b-e392-4a20-a617-85f0fa41f750 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.157828 May 10 14:18:40.316368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 188/378] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:40 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:41.332907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:41.333439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:41.339395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:41.339845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:41.340612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:41.341041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:41.468066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:41.476071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd08e9ee-aa61-40ed-9aa6-c11153fed742 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.147192 May 10 14:18:41.476642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 191/379] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:41 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:42.492956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:42.493559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:42.499912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:42.500355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:42.501115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:42.501546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:42.635477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:42.642970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0530ec6d-c265-45cf-b8b9-d7ef4eea5f72 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.153840 May 10 14:18:42.643537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 189/380] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:42 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:43.662853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:43.663465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:43.669899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:43.670373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:43.671163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:43.671596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:43.835495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:43.842806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22b14266-d8cb-4345-a0f6-57e02ab0c7ed tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.185460 May 10 14:18:43.843363 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 192/381] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:43 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:44.860131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:44.860655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:44.867830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:44.868282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:44.869049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:44.869485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:44.997655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:45.005278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ed902e2c-97d4-4477-9cff-065706cbb203 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.149093 May 10 14:18:45.005840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 190/382] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:44 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:46.022600 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:46.023469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:46.029579 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:46.030085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:46.031032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:46.031494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:46.159141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:46.167217 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd253856-e05a-4869-8a0d-1e8019798a1d tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.149524 May 10 14:18:46.167783 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 193/383] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:46 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:47.184721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:47.185383 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:47.191934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:47.192464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:47.193245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:47.193681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:47.334439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:47.342916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dcde2edc-34c7-4470-ad0c-1bcdd8a67326 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.162050 May 10 14:18:47.344070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 191/384] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:47 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:48.363107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:48.366912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:48.377959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:48.378996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:48.379900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:48.380335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:48.571546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:48.579386 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3bce9738-f608-473c-a7de-fd05175bbe3f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.221576 May 10 14:18:48.579972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 194/385] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:48 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:49.597790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:49.598572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:49.605732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:49.606193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:49.607004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:49.607609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:49.821969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:49.837854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d7998c42-1c6c-4c63-8745-afed84263666 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.244421 May 10 14:18:49.838474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 192/386] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:49 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:50.861314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:50.863846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:50.870367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:50.871123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:50.872108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:50.872725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:51.046980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:51.058055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41d2cc32-7be8-4d62-a9a4-a601d88fcdff tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.200672 May 10 14:18:51.059147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 195/387] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:50 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:52.079564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:52.080929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:52.091454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:52.092912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:52.099112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:52.100501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:52.313968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:52.323516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-448ebb5d-7697-4697-9d51-b652709d21a9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.248008 May 10 14:18:52.324110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 193/388] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:52 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:53.341223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:53.341855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:53.348967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:53.349423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:53.350283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:53.350725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:53.508027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:53.515919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-959df575-a1ad-4e61-acd2-38a7c46df999 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.178747 May 10 14:18:53.517044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 196/389] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:53 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:54.535999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:54.536876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:54.548482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:54.549026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:54.550535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:54.551879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:54.732322 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:54.738353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e45e4cc3-6334-4695-adc1-76f15d8953c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1502 microversion: 2.1 time: 0.207495 May 10 14:18:54.739479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 194/390] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:54 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:54.759978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca9c90bf-7597-4ccc-b1eb-0818460b9837"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:54.761375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:54.783156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:54.783847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:54.785771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:54.787160 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:54.827631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] HTTP exception thrown: Cannot 'attach_volume' instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 while it is in vm_state rescued May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Request method failure captured: May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797/os-volume_attachments HTTP/1.1 May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 74 May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPMqt8nEpdvfNrB-sXwTr0irXFMStdPkuBn7pYfF7tMdf2nAJuVnijPn12slEXDjzVetdWYlf5FTDKFih0lrzaS9pW3RmrkLU0SCgCwNdPyrBv7MnMrgMAyMwjiCP7S2ht8V5CY8FzEbQduLLW_GZCgk_G7dkMba2XOcYCe2sPSPf4 May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:18:54.829193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8a7f6dc00b5487b9c323783ef5aaa2b"}]}] May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 5e3edc87e7014d8598ba8c9517b81cf7 May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {"volumeAttachment": {"volumeId": "ca9c90bf-7597-4ccc-b1eb-0818460b9837"}} May 10 14:18:54.830735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Cannot 'attach_volume' instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 while it is in vm_state rescued May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '0a8bc09f-ec85-4865-93b7-28628f5b8797', 'body': {'volumeAttachment': {'volumeId': 'ca9c90bf-7597-4ccc-b1eb-0818460b9837'}}} May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:18:54.831676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 while it is in vm_state rescued May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:18:54.833755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:18:54.835062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:18:54.835062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:18:54.835062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 while it is in vm_state rescued May 10 14:18:54.835062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:18:54.835062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Returning 409 to user: Cannot 'attach_volume' instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 while it is in vm_state rescued {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:18:54.835062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-88e0ab25-866a-4eb3-9694-f690a9ee3b56 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074735 May 10 14:18:54.835062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 197/391] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:18:54 2022] POST /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 14:18:54.846257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fe9a2bdd-a07d-48b3-9a27-15cf767736af tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:54.846257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fe9a2bdd-a07d-48b3-9a27-15cf767736af tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:54.850685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe9a2bdd-a07d-48b3-9a27-15cf767736af tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:54.851307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe9a2bdd-a07d-48b3-9a27-15cf767736af tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:54.852241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe9a2bdd-a07d-48b3-9a27-15cf767736af tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:54.852797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe9a2bdd-a07d-48b3-9a27-15cf767736af tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:55.052443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fe9a2bdd-a07d-48b3-9a27-15cf767736af tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797/action" status: 202 len: 0 microversion: 2.1 time: 0.215321 May 10 14:18:55.053597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 195/392] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:18:54 2022] POST /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:18:55.065022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:55.065851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:55.081330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:55.085901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:55.087469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:55.088403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:55.282763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:55.292786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb0c0a84-5c2d-40dd-82ab-45d1e213d030 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1510 microversion: 2.1 time: 0.231267 May 10 14:18:55.293830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 198/393] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:55 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:56.313822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:56.314655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:56.321905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:56.322632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:56.323556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:56.324140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:56.536095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:56.549987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba3a0d2e-4af6-4489-aafc-87d37179dfbb tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1510 microversion: 2.1 time: 0.241452 May 10 14:18:56.551584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 196/394] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:56 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:57.574950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:57.575577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:57.581430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:57.582062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:57.583014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:57.583443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:57.737273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:57.750042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e716d8eb-504e-4862-b1d6-f83fcebf6a71 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1510 microversion: 2.1 time: 0.178802 May 10 14:18:57.750684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 199/395] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:57 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:58.767282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:58.768048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:58.778042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:58.778534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:58.779321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:58.780002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:58.986362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:58.996397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b4e113ab-cde2-4cfa-9069-e693e877c400 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1510 microversion: 2.1 time: 0.232803 May 10 14:18:58.999526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 197/396] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:18:58 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:00.016624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:00.018524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:00.029911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:00.030897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:00.031790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:00.032522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:00.210965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:00.219799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9bed1e6c-84b3-44ca-a3e2-4b1b953c39ec tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1510 microversion: 2.1 time: 0.208254 May 10 14:19:00.230612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 200/397] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:00 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:01.242584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:01.243057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:01.249407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:01.250696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:01.251210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:01.251647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:01.506795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:01.517845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f22eeecb-ccbe-4a44-b85b-d4c7e9680d23 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1516 microversion: 2.1 time: 0.280241 May 10 14:19:01.518751 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 198/398] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:01 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:04.365813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84c4d6aa-02d9-4ea1-9e26-33247e09008e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'create', calling method: .version_select at 0x7fef845d1700>, body: {"keypair": {"name": "tempest-keypair-675753142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6LKD6V195sCrXPniu6NUZzFJtnyl91FmHFKeaI0/XDfbddl4/DhpUSLEScAa1S/VFOIyFhfT+c6yTZNgLcQKS3CmuQXmX0t3Wi4owjdrdCLT17Xibq+jviIoj7AVuJg=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:04.381071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-84c4d6aa-02d9-4ea1-9e26-33247e09008e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:19:04.385270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-84c4d6aa-02d9-4ea1-9e26-33247e09008e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for user 5e3edc87e7014d8598ba8c9517b81cf7 and project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:19:04.474710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84c4d6aa-02d9-4ea1-9e26-33247e09008e tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113135 May 10 14:19:04.475309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 201/399] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:19:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:06.130690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e5a497dd-e45b-44b7-9953-74db10513889 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ccd700a-edd1-4849-8705-72b6b4f707f1", "device": "/dev/sdb"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:06.132294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e5a497dd-e45b-44b7-9953-74db10513889 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:06.138588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a497dd-e45b-44b7-9953-74db10513889 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:06.139056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a497dd-e45b-44b7-9953-74db10513889 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:06.139821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a497dd-e45b-44b7-9953-74db10513889 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:06.140250 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a497dd-e45b-44b7-9953-74db10513889 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:06.800718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e5a497dd-e45b-44b7-9953-74db10513889 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "POST /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674447 May 10 14:19:06.801393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 199/400] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:19:06 2022] POST /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:07.229521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-644810274", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76e2bc11-fa39-4fbb-bbfd-3797d10be68b"}], "security_groups": [{"name": "tempest-securitygroup--931682749"}], "key_name": "tempest-keypair-675753142", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:07.328143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] validate_networks() for [('76e2bc11-fa39-4fbb-bbfd-3797d10be68b', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:19:07.695475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:19:07.695475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:19:07.695475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:19:07.695475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:19:07.695475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:19:07.705860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:07.705860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:07.706443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:07.707552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:07.726913 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:19:07.731062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Getting quotas for user 5e3edc87e7014d8598ba8c9517b81cf7 and project b8a7f6dc00b5487b9c323783ef5aaa2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:19:07.742422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:19:07.744730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:19:07.896113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7698391a-12ac-4c81-9a50-4f2165fab099 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.670858 May 10 14:19:07.897035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 202/401] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:19:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:19:07.907948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7692123c-e03e-4596-93c7-f7d597923d0f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:07.908586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7692123c-e03e-4596-93c7-f7d597923d0f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:07.972468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7692123c-e03e-4596-93c7-f7d597923d0f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:07.984963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7692123c-e03e-4596-93c7-f7d597923d0f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1244 microversion: 2.1 time: 0.080949 May 10 14:19:07.986070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 200/402] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:07 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:09.007219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:09.007834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:09.013968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:09.014463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:09.015246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:09.015686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:09.079665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:09.085574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ca7a704-224f-44ce-baf2-d67e9999d99c tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1248 microversion: 2.1 time: 0.082852 May 10 14:19:09.086154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 203/403] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:09 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:10.108232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:10.115464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:10.119806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:10.120509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:10.121490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:10.122130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:10.214975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:10.222436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f6e70ae2-79ec-457a-a134-c32e67788c01 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1314 microversion: 2.1 time: 0.124521 May 10 14:19:10.223588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 201/404] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:10 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1314 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:11.240652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:11.241464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:11.247404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:11.247927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:11.248691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:11.249115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:11.380741 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:11.388211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a49ccd2f-adf4-4cd9-bf2f-d56781e65d06 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.151819 May 10 14:19:11.388803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 204/405] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:11 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:12.268905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-07b5e466-97af-4319-bc04-e5c2a6a3f71f req-564d8e02-c1e6-456f-9836-b3d957122013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0793014a-3668-44ee-81e2-19d304f47d99", "tag": "54d433f1-3d6f-4e94-ab61-07a30d771d0c"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:12.310612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-07b5e466-97af-4319-bc04-e5c2a6a3f71f req-564d8e02-c1e6-456f-9836-b3d957122013 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:12.316733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-07b5e466-97af-4319-bc04-e5c2a6a3f71f req-564d8e02-c1e6-456f-9836-b3d957122013 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:12.339722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-07b5e466-97af-4319-bc04-e5c2a6a3f71f req-564d8e02-c1e6-456f-9836-b3d957122013 service nova] Creating event network-changed:54d433f1-3d6f-4e94-ab61-07a30d771d0c for instance 0793014a-3668-44ee-81e2-19d304f47d99 on hv-cinder-84112 May 10 14:19:12.345274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-07b5e466-97af-4319-bc04-e5c2a6a3f71f req-564d8e02-c1e6-456f-9836-b3d957122013 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080103 May 10 14:19:12.349236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 202/406] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:12.406371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:12.407710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:12.417735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:12.418518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:12.419647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:12.420288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:12.610044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:12.619046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0d1bb03-01ef-4549-8899-4f35f8ecc7a1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.217511 May 10 14:19:12.619930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 205/407] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:12 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:13.637330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:13.638029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:13.644700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:13.645149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:13.645926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:13.646401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:13.805208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:13.813827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-37659426-b81c-4ec8-876e-2803b39aabe5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.181060 May 10 14:19:13.814683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 203/408] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:13 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:19:14.835958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:14.838924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:14.842505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:14.842950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:14.843720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:14.844168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:14.977249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:14.984596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b322bb9d-9ed1-4614-bfca-a51b8f35a5ad tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.155292 May 10 14:19:14.985145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 206/409] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:14 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:16.004992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:16.005629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:16.012058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:16.012508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:16.013273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:16.013706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:16.142437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:16.150046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-39407ab5-f793-43dd-8916-1c300f1b9f59 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.149594 May 10 14:19:16.150635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 204/410] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:15 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:17.167735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:17.168354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:17.174287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:17.174800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:17.175593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:17.176236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:17.312798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:17.320835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e49b0d5d-0dfc-4495-9424-7d238ca236c6 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.156907 May 10 14:19:17.321434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 207/411] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:17 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:18.337461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:18.338070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:18.344197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:18.344639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:18.345399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:18.345825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:18.491921 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:18.499415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-497034c0-0d9f-4b62-84c5-4f61898b2391 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.165916 May 10 14:19:18.500136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 205/412] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:18 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:19.488799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-f53d260b-453f-42ee-8ea2-1b474c20a915 req-234f3914-8256-4c82-904d-226068460170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0793014a-3668-44ee-81e2-19d304f47d99", "name": "network-vif-plugged", "status": "completed", "tag": "54d433f1-3d6f-4e94-ab61-07a30d771d0c"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:19.497545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f53d260b-453f-42ee-8ea2-1b474c20a915 req-234f3914-8256-4c82-904d-226068460170 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:19.503128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f53d260b-453f-42ee-8ea2-1b474c20a915 req-234f3914-8256-4c82-904d-226068460170 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:19.509876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-f53d260b-453f-42ee-8ea2-1b474c20a915 req-234f3914-8256-4c82-904d-226068460170 service nova] Creating event network-vif-plugged:54d433f1-3d6f-4e94-ab61-07a30d771d0c for instance 0793014a-3668-44ee-81e2-19d304f47d99 on hv-cinder-84112 May 10 14:19:19.515592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-f53d260b-453f-42ee-8ea2-1b474c20a915 req-234f3914-8256-4c82-904d-226068460170 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030722 May 10 14:19:19.516377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 208/413] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:19.518989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:19.520137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:19.540934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:19.541389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:19.542189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:19.542646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:19.683505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:19.691057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9e5bc347-400e-48a4-bece-c71c59e4aad8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.177580 May 10 14:19:19.692525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 206/414] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:19 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:20.709502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:20.710717 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:20.717113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:20.717558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:20.718424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:20.718855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:20.848061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:20.855316 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e88dd5d2-9587-4661-b18c-58ca382e5ebf tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.150244 May 10 14:19:20.855872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 209/415] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:20 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:21.873010 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:21.873535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:21.880649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:21.881089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:21.881846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:21.882305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:22.010184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:22.017401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2d6b733a-bfdd-4d40-97d8-06b00ffb32d5 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.148319 May 10 14:19:22.017964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 207/416] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:21 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:23.035197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:23.037202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:23.044541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:23.044998 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:23.045833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:23.046335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:23.188748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:23.197521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff589661-8c3a-4697-aa8b-2761dee0ff9f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.166277 May 10 14:19:23.199428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 210/417] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:23 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:24.214649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:24.215172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:24.222482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:24.223002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:24.224124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:24.224585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:24.364384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:24.371655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bcaf0596-54f7-4315-9f3b-944b8d50c4de tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.161061 May 10 14:19:24.372223 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 208/418] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:24 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:25.388699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:25.389306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:25.396251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:25.396725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:25.397500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:25.398269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:25.531508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:25.541165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8e4e17d0-a257-4bc8-a816-2ca5451c718f tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1369 microversion: 2.1 time: 0.156167 May 10 14:19:25.541974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 211/419] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:25 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:26.558091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:26.558743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:26.565258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:26.565715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:26.566528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:26.567004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:26.696917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:26.704221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-255f916f-9434-4e85-8c09-d43295276b87 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1564 microversion: 2.1 time: 0.149989 May 10 14:19:26.704979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 209/420] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:26 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:26.720728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd184fe2-ce8d-411c-b369-d1279dc1e9c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:26.721237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd184fe2-ce8d-411c-b369-d1279dc1e9c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:26.728251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd184fe2-ce8d-411c-b369-d1279dc1e9c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:26.728690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd184fe2-ce8d-411c-b369-d1279dc1e9c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:26.729451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd184fe2-ce8d-411c-b369-d1279dc1e9c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:26.729883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd184fe2-ce8d-411c-b369-d1279dc1e9c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:26.805807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd184fe2-ce8d-411c-b369-d1279dc1e9c1 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088861 May 10 14:19:26.806463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 212/421] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 10 14:19:26 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:28.248310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-f9624df7-7bd6-494a-a89d-ac7aa29c7aae req-4f8c323d-2961-4972-a178-95969ab11746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0793014a-3668-44ee-81e2-19d304f47d99", "tag": "54d433f1-3d6f-4e94-ab61-07a30d771d0c"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:28.256706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-f9624df7-7bd6-494a-a89d-ac7aa29c7aae req-4f8c323d-2961-4972-a178-95969ab11746 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:28.257154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-f9624df7-7bd6-494a-a89d-ac7aa29c7aae req-4f8c323d-2961-4972-a178-95969ab11746 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:28.267717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-f9624df7-7bd6-494a-a89d-ac7aa29c7aae req-4f8c323d-2961-4972-a178-95969ab11746 service nova] Creating event network-changed:54d433f1-3d6f-4e94-ab61-07a30d771d0c for instance 0793014a-3668-44ee-81e2-19d304f47d99 on hv-cinder-84112 May 10 14:19:28.273127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-f9624df7-7bd6-494a-a89d-ac7aa29c7aae req-4f8c323d-2961-4972-a178-95969ab11746 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028645 May 10 14:19:28.273710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 210/422] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:45.480514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:45.481006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:45.487077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:45.487527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:45.488309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:45.488943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:45.619975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:19:45.905826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f96df2d3-f98a-432e-b9d7-91109f98797a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0/os-volume_attachments/2ccd700a-edd1-4849-8705-72b6b4f707f1" status: 202 len: 0 microversion: 2.1 time: 0.428999 May 10 14:19:45.906735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 213/423] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:19:45 2022] DELETE /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0/os-volume_attachments/2ccd700a-edd1-4849-8705-72b6b4f707f1 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:19:48.089329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:48.090659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:48.103299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:48.103834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:48.104720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:48.105222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:48.136684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:19:48.507863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ccebaf5-0a6f-49f0-8ac1-921dc1fa3bdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 204 len: 0 microversion: 2.1 time: 0.423712 May 10 14:19:48.508709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 211/424] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:19:48 2022] DELETE /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:19:48.518216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:48.518973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:48.526446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:48.526960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:48.527782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:48.528210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:48.666796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:48.674753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3236c6c3-670e-4a77-8d5a-e5129dd6c69a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1515 microversion: 2.1 time: 0.161216 May 10 14:19:48.675534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 214/425] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:48 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:19:49.694435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:49.696069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:49.708289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:49.709008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:49.710025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:49.712390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:49.853496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:49.860977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b97e42f6-21c4-4181-96db-52ac4cbecee1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1515 microversion: 2.1 time: 0.171736 May 10 14:19:49.861542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 212/426] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:49 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:50.878777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:50.882079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:50.886151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:50.886845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:50.887647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:50.888080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:51.051853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:51.059945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-201d0ea5-6483-4197-b6f3-470755647fef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1515 microversion: 2.1 time: 0.184971 May 10 14:19:51.070605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 215/427] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:50 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:52.077241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:52.078031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:52.086375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:52.087118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:52.088213 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:52.088857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:52.228619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:52.236006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-14c5c127-843e-4f4d-b704-be53d71d6ba2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1515 microversion: 2.1 time: 0.162982 May 10 14:19:52.236591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 213/428] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:52 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:52.381259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-b0125d61-522b-4b6c-8575-e91f32c76a1a req-82fb7284-0abf-4224-9fb9-ffd2b3852daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ab87ed-87c5-4255-8a75-6e5add1c4ce0", "name": "network-vif-deleted", "tag": "ad53262e-0d17-48e0-a428-2a9c5dea914e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:52.389162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b0125d61-522b-4b6c-8575-e91f32c76a1a req-82fb7284-0abf-4224-9fb9-ffd2b3852daf service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:52.389607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b0125d61-522b-4b6c-8575-e91f32c76a1a req-82fb7284-0abf-4224-9fb9-ffd2b3852daf service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:52.400083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-b0125d61-522b-4b6c-8575-e91f32c76a1a req-82fb7284-0abf-4224-9fb9-ffd2b3852daf service nova] Creating event network-vif-deleted:ad53262e-0d17-48e0-a428-2a9c5dea914e for instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 on hv-cinder-84112 May 10 14:19:52.405003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-b0125d61-522b-4b6c-8575-e91f32c76a1a req-82fb7284-0abf-4224-9fb9-ffd2b3852daf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028018 May 10 14:19:52.405584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 216/429] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:53.256975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:53.259205 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:53.266520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:53.266997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:53.267771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:53.268203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:53.300248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:53.300703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:53.301160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'fault' on Instance uuid 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:19:53.345550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:53.352012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e3a4a6c-5d3d-471b-a19e-efeb5547c9ab tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 200 len: 1309 microversion: 2.1 time: 0.101431 May 10 14:19:53.352587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 214/430] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:53 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:54.370809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:54.371497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 77ab87ed-87c5-4255-8a75-6e5add1c4ce0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:54.381498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:54.381498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:54.382181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:54.382646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:54.396975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 could not be found. May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 HTTP/1.1 May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:19:54.399137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 could not be found. May 10 14:19:54.400711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '77ab87ed-87c5-4255-8a75-6e5add1c4ce0'} May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 could not be found. May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:19:54.401706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 could not be found. May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 could not be found. May 10 14:19:54.403188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:19:54.405327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 404 to user: Instance 77ab87ed-87c5-4255-8a75-6e5add1c4ce0 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:19:54.406285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a48f7002-450a-4e37-a17d-f34b5bf537f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0" status: 404 len: 111 microversion: 2.1 time: 0.039858 May 10 14:19:54.406822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 217/431] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:19:54 2022] GET /compute/v2.1/servers/77ab87ed-87c5-4255-8a75-6e5add1c4ce0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:19:59.090297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3eed481e-af8c-4ce6-af3b-43d5f0305017 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Action: 'create', calling method: .version_select at 0x7fef8450f280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1282433387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVO2Ad+OXyf2gM+AqYtGEFilBuXcb/ZqQC24Wsf1r/mb0Jgpsqofu9ChaaTuLmaH+bEPTWkkSLMrI/RBVMXMvGt9Qntn5QXfuK1fBQB6gYTWrg4St1J4jWYYBQIgfJ8+A=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:59.105008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-3eed481e-af8c-4ce6-af3b-43d5f0305017 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Getting quotas for project 674aa2ca44674c908e6393ef25d6719a. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:19:59.108790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-3eed481e-af8c-4ce6-af3b-43d5f0305017 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Getting quotas for user 98be3f9cd80e4f62972dbf48591c7dd4 and project 674aa2ca44674c908e6393ef25d6719a. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:19:59.228743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3eed481e-af8c-4ce6-af3b-43d5f0305017 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.332989 May 10 14:19:59.229353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 215/432] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:19:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:07.205485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1657121777", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "networks": [{"uuid": "f2ec8871-40d2-4900-a07b-6b81ad4c336e"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:07.256810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] validate_networks() for [('f2ec8871-40d2-4900-a07b-6b81ad4c336e', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:20:07.603389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:20:07.603804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:20:07.604296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:20:07.604724 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:20:07.605127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:20:07.615556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:07.616144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:07.618118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:07.618887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:07.636160 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Getting quotas for project 709b9712f09a42a785d046e0c0f3846e. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:20:07.640387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Getting quotas for user 48efa16cb9844fcd853f1e3760619a66 and project 709b9712f09a42a785d046e0c0f3846e. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:20:07.651592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:20:07.653851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:20:07.824693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3db9f62-4688-4eb5-9b9a-1a8a68e7d5b9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623113 May 10 14:20:07.825393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 218/433] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:20:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:20:07.839420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-929c7295-6e61-4ae2-8a87-8d2120d4a448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:07.840078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-929c7295-6e61-4ae2-8a87-8d2120d4a448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:07.909428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-929c7295-6e61-4ae2-8a87-8d2120d4a448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:07.909428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-929c7295-6e61-4ae2-8a87-8d2120d4a448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1219 microversion: 2.1 time: 0.075818 May 10 14:20:07.909428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 216/434] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:07 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:08.924752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:08.925342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:08.934642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:08.935087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:08.935858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:08.936287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:08.996480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:09.003818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-223b3113-89a8-48aa-8985-d8240f917811 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1215 microversion: 2.1 time: 0.083003 May 10 14:20:09.004376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 219/435] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:08 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:10.021817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:10.022305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:10.028778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:10.029225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:10.029992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:10.030453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:10.106800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:10.114799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f3fec858-ca9d-4662-ad5b-f76c9a62ad9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1289 microversion: 2.1 time: 0.097435 May 10 14:20:10.115506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 217/436] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:10 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:11.133608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:11.135096 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:11.141212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:11.141654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:11.142447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:11.142876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:11.301759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:11.309358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86da31e6-357d-4a79-9db4-4ce45a6357b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.181213 May 10 14:20:11.309921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 220/437] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:11 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:11.400644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-42b079ee-9612-456b-94c0-3ba8f44792ad req-8a5e4582-2f4b-4bb4-9b49-35a43078e209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c342ab3-912f-4596-b007-862a7aa84479", "tag": "dc933eb9-793c-490d-9d5b-57cee818dbd4"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:11.410377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-42b079ee-9612-456b-94c0-3ba8f44792ad req-8a5e4582-2f4b-4bb4-9b49-35a43078e209 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:11.414738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-42b079ee-9612-456b-94c0-3ba8f44792ad req-8a5e4582-2f4b-4bb4-9b49-35a43078e209 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:11.424305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-42b079ee-9612-456b-94c0-3ba8f44792ad req-8a5e4582-2f4b-4bb4-9b49-35a43078e209 service nova] Creating event network-changed:dc933eb9-793c-490d-9d5b-57cee818dbd4 for instance 9c342ab3-912f-4596-b007-862a7aa84479 on hv-cinder-84112 May 10 14:20:11.429326 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-42b079ee-9612-456b-94c0-3ba8f44792ad req-8a5e4582-2f4b-4bb4-9b49-35a43078e209 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033968 May 10 14:20:11.430152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 218/438] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:12.326978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:12.327568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:12.333767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:12.334244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:12.335020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:12.335446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:12.470352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:12.479272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9215a1f-00f4-46bd-831d-7b0b9189a6ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.156444 May 10 14:20:12.479836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 221/439] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:12 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:13.496375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:13.497061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:13.503522 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:13.503961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:13.504716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:13.505212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:13.637954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:13.645362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73f7eb53-f0e9-43ef-9841-ca23b0fc6755 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.153129 May 10 14:20:13.645957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 219/440] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:13 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:14.663244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:14.663838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:14.669994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:14.670467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:14.671678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:14.672266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:14.800750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:14.808120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb843822-aa34-46f7-bb90-193944139612 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.149320 May 10 14:20:14.808679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 222/441] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:14 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:15.824891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:15.825498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:15.831767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:15.832210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:15.832966 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:15.833995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:15.964741 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:15.972005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e05a6112-5ab0-4a44-91e0-6737258f2aaa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.150939 May 10 14:20:15.972621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 220/442] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:15 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:16.989152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:16.989670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:16.995978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:16.996483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:16.997266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:16.997688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:17.130954 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:17.138619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7ac6c1d-fdee-4ee6-b17c-7bc5127fbbeb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.153412 May 10 14:20:17.139183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 223/443] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:16 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:18.156030 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:18.156643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:18.163570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:18.164020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:18.164801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:18.165211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:18.310501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:18.318375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c52d683c-f065-49ea-a405-d484617aaf98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.166015 May 10 14:20:18.318972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 221/444] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:18 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:19.335877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:19.336682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:19.342680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:19.343126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:19.343896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:19.344329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:19.487256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:19.495376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bf7d01b3-4f97-471c-bdd6-6bdcd3884461 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.163996 May 10 14:20:19.495943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 224/445] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:19 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:20.511998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:20.512613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:20.518860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:20.519299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:20.520049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:20.520475 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:20.650520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:20.658413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2f4c3496-ea18-4326-8f28-bd506e368d65 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.150204 May 10 14:20:20.658979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 222/446] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:20 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:21.675948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:21.676678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:21.682781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:21.683333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:21.684086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:21.684515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:21.819218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:21.826351 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c146981-5d6a-4a2c-a448-4181c177fde7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.154344 May 10 14:20:21.826917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 225/447] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:21 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:22.844182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:22.844790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:22.851673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:22.852130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:22.852889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:22.853321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:22.979695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:22.986881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d98b3af5-050c-44a0-941c-f17fcf4e4a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.146569 May 10 14:20:22.987859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 223/448] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:22 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:24.004550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:24.005143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:24.012299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:24.012741 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:24.013502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:24.013928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:24.145561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:24.152852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d14ea3f0-da8d-4de7-b7cf-34906f708ed2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.152187 May 10 14:20:24.153407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 226/449] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:23 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:25.169899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:25.170545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:25.176812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:25.177264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:25.178086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:25.178515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:25.308993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:25.316097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ca87d5ef-0346-4753-b743-f073e1359c2a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.150384 May 10 14:20:25.316652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 224/450] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:25 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:26.332703 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:26.333367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:26.339326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:26.339792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:26.340752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:26.341211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:26.489026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:26.496799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d7402fff-6472-4123-8a58-54bf9fa72cc2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.167882 May 10 14:20:26.497373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 227/451] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:26 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:27.514606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:27.515239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:27.522103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:27.522579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:27.523379 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:27.523807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:27.688871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:27.696362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73e6a2e6-3f9d-4f75-b043-a9165acb0b0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.185654 May 10 14:20:27.706063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 225/452] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:27 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:28.618476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-ecbd2bbf-3c8e-4808-b02f-89cb0179a0cc req-678ad177-a77c-4864-aa76-df23425b2584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c342ab3-912f-4596-b007-862a7aa84479", "name": "network-vif-plugged", "status": "completed", "tag": "dc933eb9-793c-490d-9d5b-57cee818dbd4"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:28.626661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ecbd2bbf-3c8e-4808-b02f-89cb0179a0cc req-678ad177-a77c-4864-aa76-df23425b2584 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:28.627104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ecbd2bbf-3c8e-4808-b02f-89cb0179a0cc req-678ad177-a77c-4864-aa76-df23425b2584 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:28.638884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-ecbd2bbf-3c8e-4808-b02f-89cb0179a0cc req-678ad177-a77c-4864-aa76-df23425b2584 service nova] Creating event network-vif-plugged:dc933eb9-793c-490d-9d5b-57cee818dbd4 for instance 9c342ab3-912f-4596-b007-862a7aa84479 on hv-cinder-84112 May 10 14:20:28.644979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-ecbd2bbf-3c8e-4808-b02f-89cb0179a0cc req-678ad177-a77c-4864-aa76-df23425b2584 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 May 10 14:20:28.645707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 228/453] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:28.714294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:28.714830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:28.720986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:28.721444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:28.722255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:28.722733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:28.883318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:28.890584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5a092f5b-eb25-4b8b-b21d-c6d86497340a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.180879 May 10 14:20:28.894632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 226/454] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:28 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:29.908104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:29.908792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:29.915082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:29.915527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:29.916321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:29.916751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:30.200503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:30.210624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7100a9fa-32c6-4c8a-90ac-fa65a4b40c8d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.306544 May 10 14:20:30.211188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 229/455] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:29 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:31.231075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:31.232570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:31.246849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:31.247830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:31.248851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:31.249566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:31.467677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:31.476545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b778b13a-4745-46c8-898a-4463fbb98551 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1319 microversion: 2.1 time: 0.252535 May 10 14:20:31.486912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 227/456] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:31 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:32.493791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:32.494730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:32.500736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:32.501187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:32.501956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:32.502421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:32.732214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:32.742359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-843f5911-9f42-4fb2-b99f-54111856c95e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1509 microversion: 2.1 time: 0.253242 May 10 14:20:32.743539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 230/457] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:32 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:20:32.759436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d76bcf0b-159a-4e25-9096-074e98e1d349 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ef3adfb-6c35-4008-8656-86d4c5526fb7", "device": "/dev/sdb"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:32.761453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d76bcf0b-159a-4e25-9096-074e98e1d349 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:32.772878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d76bcf0b-159a-4e25-9096-074e98e1d349 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:32.775096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d76bcf0b-159a-4e25-9096-074e98e1d349 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:32.776823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d76bcf0b-159a-4e25-9096-074e98e1d349 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:32.777278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d76bcf0b-159a-4e25-9096-074e98e1d349 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:33.782176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d76bcf0b-159a-4e25-9096-074e98e1d349 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "POST /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.026554 May 10 14:20:33.782864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 228/458] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:20:32 2022] POST /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments => generated 194 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:35.381084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2047251980", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1282433387", "security_groups": [{"name": "tempest-secgroup-smoke-1772883074"}], "block_device_mapping_v2": [{"uuid": "f57cc83b-5c21-4bef-97f9-c2fbe4e27d4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94a6c4ba-82d5-4dc0-a594-f781d990198f"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:35.524996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] validate_networks() for [('94a6c4ba-82d5-4dc0-a594-f781d990198f', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:20:35.979698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:20:35.980393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:20:35.981724 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:20:35.982331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:20:35.982933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:20:36.003357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:36.004715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:36.005860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:36.008178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:36.034878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Getting quotas for project 674aa2ca44674c908e6393ef25d6719a. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:20:36.039806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Getting quotas for user 98be3f9cd80e4f62972dbf48591c7dd4 and project 674aa2ca44674c908e6393ef25d6719a. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:20:36.104612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:20:36.107204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f57cc83b-5c21-4bef-97f9-c2fbe4e27d4c',volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:20:36.635728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9aaaea75-f6bf-470a-b791-c2bae8fc2952 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259641 May 10 14:20:36.636378 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 231/459] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:20:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:20:36.648936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7277aaad-1ab2-4d34-95c5-292057e97275 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:36.649570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7277aaad-1ab2-4d34-95c5-292057e97275 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:36.749282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7277aaad-1ab2-4d34-95c5-292057e97275 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:36.761759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7277aaad-1ab2-4d34-95c5-292057e97275 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1095 microversion: 2.1 time: 0.112899 May 10 14:20:36.772240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 229/460] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:36 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1095 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:37.773643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a664e77a-6ccd-49c7-8fe1-7518b25d0221 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:37.774446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a664e77a-6ccd-49c7-8fe1-7518b25d0221 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:37.829928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a664e77a-6ccd-49c7-8fe1-7518b25d0221 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:37.840866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a664e77a-6ccd-49c7-8fe1-7518b25d0221 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1095 microversion: 2.1 time: 0.068809 May 10 14:20:37.840866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 232/461] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:37 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:38.531453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-42ca6b64-1469-4550-8d34-a8a1ac2df183 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:38.532021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2776c02a-d4bf-4f4f-a687-5789cc373e50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:38.532523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-42ca6b64-1469-4550-8d34-a8a1ac2df183 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:38.538775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2776c02a-d4bf-4f4f-a687-5789cc373e50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:38.555970 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2776c02a-d4bf-4f4f-a687-5789cc373e50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:38.557506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2776c02a-d4bf-4f4f-a687-5789cc373e50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:38.558677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42ca6b64-1469-4550-8d34-a8a1ac2df183 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:38.559315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42ca6b64-1469-4550-8d34-a8a1ac2df183 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:38.560098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42ca6b64-1469-4550-8d34-a8a1ac2df183 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:38.560670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2776c02a-d4bf-4f4f-a687-5789cc373e50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:38.561116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2776c02a-d4bf-4f4f-a687-5789cc373e50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:38.562650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42ca6b64-1469-4550-8d34-a8a1ac2df183 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:38.592625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-42ca6b64-1469-4550-8d34-a8a1ac2df183 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/ips" status: 200 len: 151 microversion: 2.20 time: 0.072636 May 10 14:20:38.593519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 230/462] 10.222.0.58 () {60 vars in 1288 bytes} [Tue May 10 14:20:38 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/ips => generated 151 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:20:38.607713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2776c02a-d4bf-4f4f-a687-5789cc373e50 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/ips" status: 200 len: 144 microversion: 2.1 time: 0.087210 May 10 14:20:38.613912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 233/463] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:20:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/ips => generated 144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:38.855789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:38.856631 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:38.864448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:38.866430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:38.868108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:38.868750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:38.973568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:38.985082 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4a70a06-984c-4c0d-b6c0-80be051bdfab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1193 microversion: 2.1 time: 0.134089 May 10 14:20:38.986184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 231/464] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:38 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1193 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:40.009142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:40.009142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:40.044080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:40.044623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:40.046379 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:40.046922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:40.139964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:40.149312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0500748f-f80c-482e-9d2b-dc481edfa6ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1211 microversion: 2.1 time: 0.150269 May 10 14:20:40.150272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 234/465] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:39 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:41.176993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:41.178545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:41.188640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:41.189351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:41.198194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:41.203811 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:41.390506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:41.399233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-317c69d3-e789-4c2b-8561-6d2a3d80436a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1279 microversion: 2.1 time: 0.235493 May 10 14:20:41.401254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 232/466] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:41 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:41.946184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:41.948975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:41.956589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:41.957043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:41.957834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:41.960690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:42.061934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lazy-loading 'flavor' on Instance uuid e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:20:42.343617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-15678839-8e64-48c2-b264-e31ca19c3174 req-82164e94-77ec-4754-a905-891cd3e60e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340be81c-5d53-4810-9dff-18bcffaec607", "tag": "6454f1f1-341d-4a6d-a2c2-1a201b99484e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:42.368077 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-15678839-8e64-48c2-b264-e31ca19c3174 req-82164e94-77ec-4754-a905-891cd3e60e4d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:42.368516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-15678839-8e64-48c2-b264-e31ca19c3174 req-82164e94-77ec-4754-a905-891cd3e60e4d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:42.407687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-15678839-8e64-48c2-b264-e31ca19c3174 req-82164e94-77ec-4754-a905-891cd3e60e4d service nova] Creating event network-changed:6454f1f1-341d-4a6d-a2c2-1a201b99484e for instance 340be81c-5d53-4810-9dff-18bcffaec607 on hv-cinder-84112 May 10 14:20:42.416376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-15678839-8e64-48c2-b264-e31ca19c3174 req-82164e94-77ec-4754-a905-891cd3e60e4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078742 May 10 14:20:42.420948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 233/467] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:20:42.427530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:42.428444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:42.435503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:42.436003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:42.436971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:42.437558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:42.688111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:42.701950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ca437707-ccd1-48ae-8191-1d04bbbcea5d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1279 microversion: 2.1 time: 0.279764 May 10 14:20:42.703032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 234/468] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:42 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:42.723957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c6fd5f2-0bbe-46a9-8272-9a6540e30533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b4b0e96-1284-4ec9-b966-5ba20c5a1812"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:42.729252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c6fd5f2-0bbe-46a9-8272-9a6540e30533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:42.765421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c6fd5f2-0bbe-46a9-8272-9a6540e30533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:42.774072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c6fd5f2-0bbe-46a9-8272-9a6540e30533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:42.774072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c6fd5f2-0bbe-46a9-8272-9a6540e30533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:42.774072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c6fd5f2-0bbe-46a9-8272-9a6540e30533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:43.138429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0bac1fd9-94e4-45fe-b521-535b9a64603c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "POST /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/action" status: 202 len: 0 microversion: 2.20 time: 1.197260 May 10 14:20:43.141250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 235/469] 10.222.0.58 () {62 vars in 1318 bytes} [Tue May 10 14:20:41 2022] POST /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/action => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:20:43.151613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:43.152676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:43.161847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:43.162448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:43.163446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:43.164179 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:43.368175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:43.378463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:43.382233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:43.383691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ddd711ec-7468-4351-90fb-4f38e9235b5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.238679 May 10 14:20:43.384945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 236/470] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:43 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:43.726058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:43.726851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:43.733530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:43.734329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:43.735781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:43.736602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:43.886970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c6fd5f2-0bbe-46a9-8272-9a6540e30533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.182504 May 10 14:20:43.894050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 235/471] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:20:42 2022] POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 194 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:44.039578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:44.048852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7becc09-fb5c-4763-9d03-830848ec75ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1279 microversion: 2.1 time: 0.332409 May 10 14:20:44.050013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 237/472] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:43 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:44.406153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:44.407600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:44.442653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:44.443107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:44.443972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:44.444394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:44.819811 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:44.841967 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:44.844924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:44.847096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c7a446fb-6f92-4bc3-aeaa-dec6806391af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.447262 May 10 14:20:44.853841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 236/473] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:44 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:20:45.072945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:45.075209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:45.089086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:45.090694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:45.093751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:45.094612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:45.294716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:45.303304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89fd1fdf-5c8a-4479-bd1f-100645f9bcb1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.238393 May 10 14:20:45.313355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 238/474] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:45 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:45.876947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:45.877554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:45.884965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:45.885413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:45.886180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:45.886636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:46.028376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:46.036412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:46.038469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:46.039632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3eebdf5-6809-4e73-ad0f-b9f197e0dbdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.166622 May 10 14:20:46.040192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 237/475] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:45 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:20:46.320689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:46.321502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:46.328972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:46.329239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:46.330034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:46.330495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:46.482092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:46.489786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76a6dd54-7def-47cf-81f3-3382ba858a78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.172835 May 10 14:20:46.499912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 239/476] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:46 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:47.059773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:47.060369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:47.066406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:47.066853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:47.067877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:47.069249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:47.243570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:47.253122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:47.256935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:47.258261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-83a19d08-adfd-4105-90f8-5f5f03e97e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.203442 May 10 14:20:47.258832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 238/477] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:47.507755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:47.508411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:47.514826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:47.515281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:47.516062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:47.516494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:47.673880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:47.682229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4468868d-c9a8-4648-8f0e-ce982967e343 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.178782 May 10 14:20:47.683089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 240/478] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:47 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:48.279764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:48.281054 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:48.288079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:48.290457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:48.291463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:48.291970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:48.455736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:48.465991 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:48.467579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:48.468750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-33f95e94-68c6-4059-b63f-3153ad73d5c5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.193132 May 10 14:20:48.469304 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 239/479] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:48 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:48.699144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:48.699870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:48.706577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:48.707030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:48.707822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:48.708258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:48.847560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:48.855108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-77a359e5-2782-4f03-9e63-b7b264ed76df tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.159932 May 10 14:20:48.856401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 241/480] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:48 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:49.489567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:49.490181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:49.498472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:49.498933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:49.499721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:49.500158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:49.650825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:49.660313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:49.661920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:49.663896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f32939f5-9b21-4a27-b4e2-f5d5af0eed28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.179631 May 10 14:20:49.674251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 240/481] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:49.872026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:49.872622 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:49.879630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:49.880071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:49.881368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:49.881793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:50.030278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:50.038120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c138f399-4a27-4f33-a05b-cc4b966db992 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.169838 May 10 14:20:50.042894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 242/482] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:49 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:50.681792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:50.682483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:50.689091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:50.689705 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:50.691099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:50.692750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:50.855340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:50.866045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:50.868379 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:50.869700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-13688bc4-e910-4211-bb7e-a48361c2aa30 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.191939 May 10 14:20:50.870525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 241/483] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:50 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:51.057753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:51.058984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:51.067854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:51.069670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:51.070192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:51.070671 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:51.261922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:51.270431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d0d156d-14b5-4cc3-8397-e8bcd60741ac tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.218047 May 10 14:20:51.280893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 243/484] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:51 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:51.888714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:51.889333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:51.896209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:51.896749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:51.897830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:51.898303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:52.043103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:52.051554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:52.053610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:52.054799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5b287a52-d896-4601-8315-ff496d660244 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.170118 May 10 14:20:52.055349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 242/485] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:51 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:52.288721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:52.289327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:52.295636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:52.296083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:52.296835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:52.297257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:52.431715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:52.438991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7abdaedd-8e8b-4da1-9b9c-cf28d2ab8c09 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.155019 May 10 14:20:52.439546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 244/486] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:52 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:53.073912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:53.074544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:53.080894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:53.081402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:53.082307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:53.082746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:53.218830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:53.226528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:53.228223 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:53.229341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-daefa342-bd57-4776-aa61-91379694c8e9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.159670 May 10 14:20:53.229893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 243/487] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:53 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:53.456027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:53.456636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:53.462593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:53.463043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:53.463809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:53.464243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:53.535158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f69e25a1-8fbf-4be6-af63-1025ecd062e6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Action: 'create', calling method: .version_select at 0x7fef844c3c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-763989755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjFkI7bP9XFy66jEFU373zimmH9OGcQ43hU6Y6M8aL++0zXQRd3SaSfvodWVDw12pZWWkW7g2iw/ifdlPeCVlRrEt1vQ3dd80YJjRUmPaSTlKEdRSPIx8Xz3CP1c20NuA=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:53.550273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f69e25a1-8fbf-4be6-af63-1025ecd062e6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Getting quotas for project 8324b5c8a0ad43b09a459a73d73dcf85. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:20:53.554720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f69e25a1-8fbf-4be6-af63-1025ecd062e6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Getting quotas for user 943d9591fc444280b105a088b32f4d4e and project 8324b5c8a0ad43b09a459a73d73dcf85. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:20:53.594716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:53.603258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2d8ad8d5-6d8e-4897-b9a2-5535ea3866ce tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151042 May 10 14:20:53.603814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 245/488] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:53 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:53.626480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f69e25a1-8fbf-4be6-af63-1025ecd062e6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.095084 May 10 14:20:53.627277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 244/489] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:20:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:20:53.675971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1998485468", "imageRef": "0838acd3-6948-4260-8cc8-cf078de1b84d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-763989755", "networks": [{"uuid": "a7eda4fe-9d71-497e-99db-e1689b5832af"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:53.725830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] validate_networks() for [('a7eda4fe-9d71-497e-99db-e1689b5832af', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:20:54.248451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:54.249058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:54.254853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:54.255294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:54.256093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:54.257039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:54.312750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:20:54.313177 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:20:54.313665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:20:54.314173 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:20:54.314610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:20:54.323906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:54.324354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:54.325162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:54.325592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:54.342512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Getting quotas for project 8324b5c8a0ad43b09a459a73d73dcf85. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:20:54.346464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Getting quotas for user 943d9591fc444280b105a088b32f4d4e and project 8324b5c8a0ad43b09a459a73d73dcf85. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:20:54.357568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:20:54.359813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0838acd3-6948-4260-8cc8-cf078de1b84d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:20:54.401559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:54.404254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:54.405761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:54.406965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5ca68936-d250-4a89-ada6-677907514091 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.163072 May 10 14:20:54.407520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 245/490] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:54 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:20:54.471548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e9b2af72-18fd-4278-8d12-38090d16c527 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799704 May 10 14:20:54.472818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 246/491] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:20:54.481901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03b85ff5-f5c5-47bd-b4d2-00a7c03056ba tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:54.482550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-03b85ff5-f5c5-47bd-b4d2-00a7c03056ba tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:54.539443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-03b85ff5-f5c5-47bd-b4d2-00a7c03056ba tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:54.546299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-03b85ff5-f5c5-47bd-b4d2-00a7c03056ba tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1258 microversion: 2.1 time: 0.068002 May 10 14:20:54.546872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 246/492] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:54 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:20:54.619816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:54.620505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:54.627422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:54.627950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:54.628796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:54.629325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:54.759715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:54.767520 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd3df227-6b08-4a70-bb8b-b14c43234de9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151533 May 10 14:20:54.768084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 247/493] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:54 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:55.425177 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:55.425821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:55.433619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:55.434074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:55.434871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:55.435310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:55.563585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:55.564192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:55.564294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:55.570619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:55.571065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:55.571839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:55.572264 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:55.572628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:55.574235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:55.575458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-22cab43a-ca37-4852-aa91-561ebf06f54d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.154278 May 10 14:20:55.576338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 247/494] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:55 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:55.637106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:55.643009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa1daf1a-1872-4f53-acfc-c885dd58afcc tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1262 microversion: 2.1 time: 0.083355 May 10 14:20:55.643593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 248/495] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:55 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:20:55.784559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:55.785167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:55.791290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:55.791740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:55.792506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:55.792940 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:55.924078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:55.932219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-36a7a36d-b612-4d94-81d1-ccabb7cda5d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151569 May 10 14:20:55.932781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 248/496] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:55 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:56.595328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:56.595846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:56.602003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.602495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:56.603278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.603710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:56.660927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:56.661535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:56.668061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.668500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:56.669254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.669947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:56.741790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:56.749136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc56b459-7ddc-4f23-94ba-3afdd1089c3c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.092040 May 10 14:20:56.749720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 249/497] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:56 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:20:56.764277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:56.772069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:56.773559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:56.774751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3753809-751d-4924-9281-9ad33a541672 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.183515 May 10 14:20:56.775472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 249/498] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:56.949260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:56.949871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:56.956033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.956481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:56.957245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.957679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:57.093993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:57.102092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb99b1a5-98bb-4898-8472-55f63e2ba2b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.156732 May 10 14:20:57.102673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 250/499] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:56 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:57.766442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:57.767044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:57.773830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:57.774365 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:57.775126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:57.775552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:57.793394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:57.794032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:57.800275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:57.800756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:57.801523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:57.801959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:57.839624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:57.846851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-463203ae-63a8-4c8a-aa0f-b9bc06b50bb4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.084194 May 10 14:20:57.850990 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 250/500] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:57 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:57.935696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:57.943656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:57.945169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:57.946348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3639795-fe26-4287-aa8b-31456f67557a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.156870 May 10 14:20:57.946901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 251/501] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:57 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:20:58.119273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:58.119797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:58.125706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.126150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:58.126955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.127390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:58.258777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:58.266176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c689398-d05e-44c5-a8cd-3081eb185a56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151691 May 10 14:20:58.266750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 251/502] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:58 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:58.763002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-06a79319-c8b1-47df-a8e5-7b448a1b8ae5 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:58.763323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-06a79319-c8b1-47df-a8e5-7b448a1b8ae5 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:58.769280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a79319-c8b1-47df-a8e5-7b448a1b8ae5 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.769726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a79319-c8b1-47df-a8e5-7b448a1b8ae5 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:58.770519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a79319-c8b1-47df-a8e5-7b448a1b8ae5 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.770954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a79319-c8b1-47df-a8e5-7b448a1b8ae5 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:58.793343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-06a79319-c8b1-47df-a8e5-7b448a1b8ae5 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3/ips" status: 200 len: 150 microversion: 2.1 time: 0.034252 May 10 14:20:58.793841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 252/503] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:20:58 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3/ips => generated 150 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:58.864563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:58.865948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:58.872477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.872918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:58.873690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.874115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:58.936313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:58.943455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5559cf02-adba-446f-bac0-1492edf57b73 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.083102 May 10 14:20:58.944014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 252/504] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:58 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:58.964520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:58.965117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:58.971535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.971978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:58.972781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:58.973162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.105726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:59.113643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:59.115246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:59.117401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4d6e314e-8404-44d3-ae1f-1a6f1b1ef9af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.156830 May 10 14:20:59.117953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 253/505] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:20:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:20:59.284709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:59.285344 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:59.291887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.292332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.293101 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.293533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.428668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:20:59.436358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16cd1d78-9b6f-464a-80a2-e2a2b1f420fc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.155463 May 10 14:20:59.436923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 253/506] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:59 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:59.960647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:59.961348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:59.969808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.970676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.971476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.971950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:00.031635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:00.038895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b3183fc4-e2db-48a6-867a-1e8711fe3376 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.082441 May 10 14:21:00.039460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 254/507] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:20:59 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:00.136743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:00.137347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:00.143394 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:00.143842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:00.144602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:00.145033 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:00.284661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:00.293002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:00.294610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:00.295950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3369d3a-1a8b-4b6c-af9f-24b626772a22 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.163193 May 10 14:21:00.296490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 254/508] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:00 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:00.452583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:00.453193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:00.459022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:00.460299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:00.461213 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:00.461646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:00.592009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:00.599669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-92f29e00-85e9-4285-8073-0c1ec35b73cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.150862 May 10 14:21:00.600328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 255/509] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:00 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:01.056742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:01.057350 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:01.063437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.063883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.064651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.065084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.131418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:01.138856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a80b3be-e76c-4feb-a863-23755da9b122 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.086712 May 10 14:21:01.139454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 255/510] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:01 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:01.314561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:01.315191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:01.322072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.322551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.323398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.323823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.451417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:01.459093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:01.460893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:01.462047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3808b76c-6de5-4f7d-9ab0-bf365235e9fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151359 May 10 14:21:01.462626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 256/511] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:01.617148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:01.617679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:01.623652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.624130 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.624894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.625328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.752123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:01.760264 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4cffc94-e88c-4249-9330-6e76fb4fd56b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.147586 May 10 14:21:01.760829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 256/512] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:01 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:02.155596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:02.156205 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:02.162169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.163584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.164352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.164846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.233523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:02.237117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-85e94038-6085-45ea-92a1-08a6cf2c0c3e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.085334 May 10 14:21:02.237683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 257/513] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:02 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:02.480442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:02.481072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:02.486804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.487247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.488003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.488435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.617034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:02.624892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:02.626457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:02.627667 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-581d870b-85e5-4e2e-a039-f0fd5a9e58d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151308 May 10 14:21:02.628233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 257/514] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:02.776941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:02.777551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:02.783886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.784338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.785098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.785533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.915007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:02.922514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bc112136-2a29-4991-ad1a-ff813a24b7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.150252 May 10 14:21:02.923074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 258/515] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:02 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:03.253009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:03.253608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:03.260248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.260691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:03.261449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.261925 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:03.328274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:03.336617 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-372da279-5777-4b84-a3d9-1d1bb0e14198 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.087494 May 10 14:21:03.337382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 258/516] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:03 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:03.646041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:03.646661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:03.652876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.653321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:03.654076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.654531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:03.782101 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:03.790899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:03.792385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:03.793542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f7e756b2-215c-4342-ac3b-ccdcd962b3ba tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151472 May 10 14:21:03.794076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 259/517] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:03 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:03.940078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:03.940686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:03.946837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.947290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:03.948061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.948497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:04.077811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:04.085625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d958fb4f-fd79-41d5-bc31-3f7ce035dfc2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.149441 May 10 14:21:04.086181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 259/518] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:03 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:04.353793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:04.354356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:04.360258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:04.360704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:04.361468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:04.361888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:04.425032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:04.432839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4caaa739-e1db-4694-93cc-e6c6be20a660 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.083137 May 10 14:21:04.433391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 260/519] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:04 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:04.811296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:04.811900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:04.817840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:04.818326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:04.819596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:04.820027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:04.945011 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:04.952804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:04.954330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:04.955471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d9e1c508-15eb-4d7c-8de0-63a49f5348ce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.148100 May 10 14:21:04.956017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 260/520] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:04 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:05.103047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:05.103785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:05.110053 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:05.110531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:05.111300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:05.111735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:05.247518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:05.254853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c9abd3a9-eeff-4a1d-8567-87381f2fe114 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.156573 May 10 14:21:05.255415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 261/521] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:05 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:05.448633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:05.449230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:05.455073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:05.455512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:05.456262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:05.456710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:05.519019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:05.526921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16366e5b-eaec-4318-8f03-7f145b465e90 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.082029 May 10 14:21:05.527477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 261/522] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:05 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:05.974791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:05.975641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:05.981762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:05.982241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:05.983024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:05.983466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:06.114852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:06.122996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:06.124487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:06.125657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20dc5cf8-62b8-4cd0-a306-172ac854a4b7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.154922 May 10 14:21:06.126222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 262/523] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:06.271475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:06.272672 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:06.278590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:06.279043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:06.279817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:06.280252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:06.409837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:06.419608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5fa96ef9-e489-44e3-b776-33719c72a3b9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151775 May 10 14:21:06.420777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 262/524] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:06 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:06.543671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:06.544209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:06.550362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:06.550817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:06.551587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:06.552023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:06.614850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:06.623987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bb023ba5-6aa4-4153-bf07-f5c569305410 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.084207 May 10 14:21:06.624556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 263/525] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:06 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:07.143585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:07.144092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:07.149983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:07.150452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:07.151206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:07.151630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:07.277240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:07.285286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:07.286828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:07.287984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed182237-4e67-4606-b012-4705333fd441 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.148427 May 10 14:21:07.288562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 263/526] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:07.436836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:07.437378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:07.443634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:07.444729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:07.445693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:07.446127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:07.572599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:07.579960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-835ee5a0-59ae-4e1d-bd5b-ba8c9525b03f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.147073 May 10 14:21:07.580527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 264/527] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:07 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:07.642223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:07.642834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:07.648787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:07.649233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:07.649993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:07.650460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:07.712591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:07.719968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-05d0d7d3-c501-49ab-bae4-6081358b8b36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.081587 May 10 14:21:07.720770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 264/528] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:07 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:08.307355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:08.307960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:08.313918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:08.314903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:08.315678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:08.316120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:08.446474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:08.454370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:08.455876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:08.457027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-204557a1-ac51-4323-915e-b8d5deb229d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.154284 May 10 14:21:08.457573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 265/529] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:08 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:08.596396 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:08.597001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:08.603527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:08.603914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:08.604680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:08.605115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:08.735381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:08.737412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:08.738020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:08.743996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4e99927-51f1-4862-8b6c-e89061a2d1c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151363 May 10 14:21:08.744578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 265/530] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:08 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:08.745818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:08.746303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:08.747084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:08.747520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:08.815374 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:08.823313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e41689c6-752b-4318-97aa-758ac3799f8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.090514 May 10 14:21:08.823872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 266/531] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:08 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:09.474412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:09.475586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:09.481659 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:09.482105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:09.482898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:09.483325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:09.611119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:09.619666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:09.621263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:09.622482 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b445bd0-7d21-49c5-aa9f-446213655919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151870 May 10 14:21:09.623034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 266/532] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:09 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:09.760214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:09.760905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:09.767399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:09.767857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:09.768629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:09.769068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:09.840466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:09.841211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:09.848261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:09.848785 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:09.849645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:09.850087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:09.924208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:09.928200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:09.931511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61d05311-d48e-43aa-bb42-3e663dc8741d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.094923 May 10 14:21:09.932083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 267/533] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:09 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:09.935965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-19d4d3c6-6506-4c67-894c-dc3b051f1fc4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.179818 May 10 14:21:09.936609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 267/534] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:09 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:10.640871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:10.641453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:10.647733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:10.648181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:10.648949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:10.649382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:10.773986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:10.781876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:10.783425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:10.784572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ce68d353-173e-4a61-b8f0-14ac7e05ef00 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.147655 May 10 14:21:10.785129 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 268/535] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:10 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:10.948256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:10.948863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:10.952488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:10.953087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:10.955234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:10.955678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:10.956438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:10.956868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:10.958836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:10.959285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:10.960319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:10.960728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:11.024012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:11.031303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8bfb0901-8bf8-45b1-84cb-f568542a558d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.087316 May 10 14:21:11.031871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 268/536] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:10 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:11.112449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:11.120709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-347f2271-6873-4ecd-ba3a-6abec6e7e5ff tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.172099 May 10 14:21:11.121266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 269/537] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:10 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:11.804350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:11.804888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:11.810931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:11.811381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:11.812144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:11.812584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:11.940717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:11.949639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:11.951165 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:11.952306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-12e3cc4a-bcff-480f-a56f-db1208186399 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.152728 May 10 14:21:11.952846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 269/538] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:11 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:12.049027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:12.049634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:12.056133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:12.056520 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:12.057286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:12.057720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:12.116252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:12.123352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c5d7b598-1b91-4c3e-b570-6fecb6c27292 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.078496 May 10 14:21:12.123915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 270/539] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:12 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:12.136854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:12.137458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:12.143744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:12.144190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:12.144946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:12.145378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:12.287250 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:12.294661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ad3aee2c-501a-4825-94fb-8e687a961ee7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.161586 May 10 14:21:12.295228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 270/540] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:12 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:12.971749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:12.972352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:12.978465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:12.978948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:12.979715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:12.980147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:13.107718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:13.115499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:13.117747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:13.118926 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7dd6582c-7600-42f0-b9df-a8e8ae537cdf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151176 May 10 14:21:13.119488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 271/541] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:12 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:13.141927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:13.142556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:13.152531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:13.152971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:13.153732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:13.154161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:13.214813 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:13.221807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-91a814a5-95a1-4a2f-a374-3b0bed5c9e8c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.085443 May 10 14:21:13.222394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 271/542] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:13 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:13.311456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:13.312064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:13.318112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:13.318589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:13.320423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:13.320853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:13.451327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:13.458549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c63d5a1-4e3f-4953-80b8-0ca346115984 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.150871 May 10 14:21:13.459092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 272/543] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:13 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:14.137175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:14.137799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:14.143861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:14.144433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:14.145076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:14.145523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:14.239889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:14.240591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:14.247031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:14.247564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:14.248407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:14.248912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:14.275864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:14.283782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:14.285271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:14.286454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0a1b2ad6-79d9-473b-98b2-106193da63d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.153156 May 10 14:21:14.287138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 272/544] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:14.308026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:14.315407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e1a22c9-0f82-415f-addd-d0745ee4f806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.079314 May 10 14:21:14.315979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 273/545] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:14 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:14.476728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:14.477334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:14.483253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:14.483702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:14.484466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:14.484904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:14.614160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:14.622140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e8a04d95-cc1a-40c0-a370-7af00eea7c61 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.149913 May 10 14:21:14.626131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 273/546] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:14 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:15.305510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:15.306116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:15.312137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:15.312567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:15.313339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:15.313772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:15.332264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:15.332902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:15.340047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:15.345016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:15.345016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:15.345016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:15.407563 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:15.414767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7a5ceac3-5591-4ccf-ae28-e7ebc3f40d71 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.086344 May 10 14:21:15.415329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 274/547] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:15 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:15.467551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:15.475343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:15.477004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:15.478146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac0c2429-81c6-4b24-97e0-291e6b96f203 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.176618 May 10 14:21:15.478895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 274/548] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:15 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:15.638649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:15.639260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:15.645144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:15.645588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:15.646385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:15.646817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:15.779570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:15.786876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e65d746f-8868-4883-9448-1495e10e7fe1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.152040 May 10 14:21:15.787437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 275/549] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:15 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:16.432399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:16.433003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:16.438899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:16.439341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:16.440104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:16.440527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:16.496696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:16.498578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:16.499526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:16.504848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:16.505297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:16.506080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:16.507156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:16.507862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c8ee280e-206f-4e47-be5b-83ee7cb2efb8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.079828 May 10 14:21:16.508443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 275/550] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:16 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:16.637545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:16.645302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:16.648805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:16.648805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a8ecde73-a234-4037-9dc4-9d5a167e6a5a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.155410 May 10 14:21:16.649142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 276/551] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:16 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:16.804487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:16.805116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:16.810999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:16.811539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:16.812239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:16.812664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:16.939782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:16.947150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-925e0ddb-b922-4157-b9a5-a93a88fd577a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.147157 May 10 14:21:16.947752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 276/552] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:16 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:17.532766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:17.533295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:17.539439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:17.539893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:17.540653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:17.541091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:17.599387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:17.606605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d340ef91-4cf5-4c6b-98df-a9f9bb8d5bf6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.077865 May 10 14:21:17.607164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 277/553] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:17 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:17.666762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:17.667360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:17.673735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:17.674177 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:17.674950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:17.675374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:17.805502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:17.813463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:17.814989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:17.816244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1478e18e-393b-4f9d-bf79-7e74d37fb769 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.153656 May 10 14:21:17.816797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 277/554] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:17 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:17.964431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:17.965038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:17.970928 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:17.971376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:17.972143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:17.972583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:18.102031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:18.109344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-49f166e4-5a9e-4506-8b87-dc37cd1b76c2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.149609 May 10 14:21:18.109906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 278/555] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:17 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:18.623519 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:18.624124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:18.630041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:18.630536 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:18.631304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:18.631821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:18.690235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:18.697864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d01e7c56-05ee-4beb-8c2c-407639aa1a58 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.078189 May 10 14:21:18.698470 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 278/556] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:18 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:18.835453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:18.836151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:18.842518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:18.842977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:18.843773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:18.844219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:18.972785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:18.981465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:18.983011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:18.984168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-81e8caf1-a6d3-48a4-8d59-902993a367f9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.153206 May 10 14:21:18.984720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 279/557] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:18 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:19.126843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:19.127444 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:19.134064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:19.134554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:19.135317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:19.135741 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:19.262375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:19.270047 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7acbce7c-1de3-415d-90b6-b73e48ca8c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.147032 May 10 14:21:19.270643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 279/558] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:19 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:19.715017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:19.715625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:19.721578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:19.722017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:19.722926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:19.723220 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:19.785933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:19.793846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2bb5542d-f7eb-4145-99bf-0531dd10adf0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.082891 May 10 14:21:19.794455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 280/559] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:19 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:20.001851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:20.002387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:20.008763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:20.009202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:20.009969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:20.010439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:20.133588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:20.141421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:20.143046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:20.144179 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b8a164a-c7cc-45ed-a073-9e3d84a24cea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.146217 May 10 14:21:20.144731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 280/560] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:19 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:20.286918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:20.287464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:20.293873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:20.294373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:20.295154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:20.295596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:20.421490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:20.429505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa8b5473-2ac9-4b4f-b6ec-f9df0bea8167 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.145901 May 10 14:21:20.430072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 281/561] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:20 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:20.811929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:20.812715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:20.818600 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:20.819087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:20.819922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:20.820347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:20.882715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:20.889854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b611e5cf-105d-409f-91ad-d70624ba967a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.082342 May 10 14:21:20.890453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 281/562] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:20 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:21.163686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:21.173824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:21.173824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:21.173824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:21.173824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:21.174187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:21.297046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:21.305441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:21.306965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:21.308109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f65b7078-7009-4d05-97f6-c40294b48ed8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.149133 May 10 14:21:21.308664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 282/563] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:21 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:21.448002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:21.448600 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:21.454640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:21.455087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:21.455833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:21.456268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:21.588735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:21.594931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ef7f3b33-e0de-4d45-bdca-4384022f4395 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151947 May 10 14:21:21.595495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 282/564] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:21 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:21.907283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:21.907884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:21.913985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:21.914466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:21.915228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:21.915661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:21.979592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:21.986799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cdf7bcbc-4388-4f0d-8027-8a5632bce3a0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.083344 May 10 14:21:21.987360 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 283/565] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:21 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:22.325744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:22.326385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:22.332384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:22.333349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:22.334115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:22.334580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:22.462887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:22.470660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:22.472185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:22.473327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e357adb0-3bb0-4892-9239-595a9ed846eb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151659 May 10 14:21:22.473888 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 283/566] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:22.612237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:22.612784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:22.621056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:22.625591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:22.625591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:22.625591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:22.794632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:22.805094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-620b48d8-15e7-4c3a-acb5-ce5f8f1c0329 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.196943 May 10 14:21:22.805790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 284/567] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:22 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:23.004070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:23.004672 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:23.010744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:23.011191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:23.011953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:23.012384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:23.074753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:23.081940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-606bf092-b181-4777-ab2e-fca0ac415484 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.081697 May 10 14:21:23.082614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 284/568] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:22 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:23.492790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:23.493393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:23.499235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:23.499678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:23.500431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:23.500866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:23.626684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:23.635787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:23.637292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:23.638530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e681d87a-15b3-4cd8-949c-ed60dc402954 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.149946 May 10 14:21:23.643195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 285/569] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:23 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:23.823035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:23.823648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:23.829716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:23.830158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:23.830942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:23.831366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:23.959338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:23.966966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fddd52bb-8a0e-4494-b55c-4e48a1607836 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.148854 May 10 14:21:23.967530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 285/570] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:23 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:24.099063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:24.099602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:24.105787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:24.106267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:24.107042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:24.107477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:24.169506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:24.177024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48ff48b7-65a4-4b1e-94b2-82289c4c43e8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.081902 May 10 14:21:24.177593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 286/571] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:24 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:24.657474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:24.658062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:24.664009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:24.664468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:24.665219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:24.665646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:24.790743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:24.798654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:24.800131 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:24.801261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c63e0565-e23c-4f2b-8b24-56dcd4812fd4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.147773 May 10 14:21:24.801814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 286/572] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:24 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:24.983394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:24.984009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:24.990376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:24.990779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:24.991550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:24.992633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.119905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:25.127214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-005dffeb-d756-49af-8de9-6b5015b09960 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.147657 May 10 14:21:25.127778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 287/573] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:24 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:25.194466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:25.195091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:25.201359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.201805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.202601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.203038 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.264617 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:25.271893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f5893ff-33f0-47cc-944c-2b0993239806 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.081291 May 10 14:21:25.272450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 287/574] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:25 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:25.820756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:25.821304 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:25.827250 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.827696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.828451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.828880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:26.103303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:26.111164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:26.112675 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:26.113824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9f659c2b-9d5d-4735-b12c-f100099d86f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.297623 May 10 14:21:26.114429 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 288/575] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:25 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:26.143564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:26.144165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:26.150036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:26.150662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:26.151463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:26.151896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:26.280530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:26.287919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86fbcd21-bf7d-4bf3-bf40-739574c50db7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.148193 May 10 14:21:26.288480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 288/576] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:26 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:26.288656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:26.289318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:26.295159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:26.295614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:26.296385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:26.297094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:26.362963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:26.370806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ac6e808b-13fb-4d88-8a02-68c5c3ca2507 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.085948 May 10 14:21:26.371378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 289/577] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:26 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:27.132747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:27.133349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:27.139502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.139948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.140715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.141146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.271010 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:27.279768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:27.281269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:27.282457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca84e062-ec26-42f5-8100-2bde142be5af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.153540 May 10 14:21:27.283017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 289/578] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:27 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:27.304726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:27.305435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:27.311874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.312330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.313097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.313535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.388069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:27.388696 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:27.394543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.394992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.395757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.396192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.451349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:27.458768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-de86292c-a92a-4c49-8697-fa9e8fb3a2b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.157676 May 10 14:21:27.459335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 290/579] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:27 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:27.470553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:27.477713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6fbefd1b-3bc7-4e6a-aba2-0207f8889f98 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.094135 May 10 14:21:27.478483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 290/580] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:27 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:28.301198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:28.301723 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:28.309112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.309792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.310341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.310778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.441212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:28.449733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:28.451339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:28.452441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9cae7d39-1a10-43d8-a33d-4b14d7efd228 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.155638 May 10 14:21:28.453023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 291/581] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:28.476003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:28.476611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:28.483165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.483614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.484381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.484817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.493487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:28.494085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:28.500219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.500695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.501504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.501945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.565934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:28.573448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-af47645c-b66b-4e06-a36e-d929448027f4 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.083622 May 10 14:21:28.574029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 292/582] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:28 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:28.685793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:28.693238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59023273-d41d-4980-966b-160211f6b439 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.221018 May 10 14:21:28.693877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 291/583] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:28 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:29.471394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:29.472007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:29.478855 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:29.479308 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:29.480084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:29.480521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:29.590288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:29.590894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:29.596743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:29.597185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:29.597943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:29.598394 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:29.607293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:29.615154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:29.616655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:29.617822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e83ce60-7189-4b3c-b7ca-e092694b2c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.150329 May 10 14:21:29.629817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 293/584] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:29 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:29.659465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:29.667234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0536cd0e-246b-42a4-a3e3-98e0a9aad2bd tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.081074 May 10 14:21:29.669362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 292/585] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:29 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:29.710569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:29.711181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:29.717628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:29.718080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:29.718880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:29.719318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:29.850526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:29.858625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2aeb20f4-6aa2-4fb7-a0fc-fb59f7709710 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.151970 May 10 14:21:29.859187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 294/586] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:29 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:30.637618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:30.638257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:30.644198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:30.644641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:30.645402 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:30.645834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:30.684882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:30.685429 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:30.691675 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:30.692124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:30.692893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:30.693324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:30.757889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:30.766106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7bcc4b62-19ab-4a2c-a486-09e02d2be31e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.085669 May 10 14:21:30.768409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 295/587] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:30 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:30.793842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:30.801767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:30.803280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:30.804443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-440138c5-6f54-462a-bc68-504724cd6e46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.171318 May 10 14:21:30.805026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 293/588] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:30 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:30.876069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:30.876892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:30.885111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:30.885557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:30.886364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:30.886799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:31.016964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:31.024300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f1170b02-c754-4841-a835-4d6859406b52 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.152838 May 10 14:21:31.024924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 296/589] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:30 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:31.782804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:31.783409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:31.789372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:31.789961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:31.790758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:31.791191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:31.823621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:31.824225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:31.830417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:31.830867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:31.831631 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:31.832063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:31.856206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:31.863516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2037d4dd-7da5-47e0-b563-74d4c7faa089 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.084543 May 10 14:21:31.864267 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 294/590] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:31 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:31.964243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:31.971979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:31.973525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:31.974662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4912d8ea-0f18-480b-b4a1-fb1709ec70ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.155517 May 10 14:21:31.975230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 297/591] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:31 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:32.041050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:32.041656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:32.047907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.048361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.049127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.049566 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.179465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:32.187324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb33b7db-c4c0-43bb-a185-963db9bcc8d4 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.150101 May 10 14:21:32.187880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 295/592] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:32 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:32.880029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:32.880658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:32.887720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.888164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.888927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.889359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.949496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:32.956624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d8332a14-c007-4106-adf0-f10672d0595d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.080378 May 10 14:21:32.957187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 298/593] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:32 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:32.992635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:32.993753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:32.999580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.000028 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:33.000800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.001234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:33.130286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:33.138819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:33.140306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:33.141477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-463a9d26-a281-4f7e-812d-06cde0c95f77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.152622 May 10 14:21:33.142016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 296/594] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:33.203530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:33.204129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:33.210012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.210483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:33.211240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.211670 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:33.339530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:33.346647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b74f61a9-d2bc-4373-840c-b1ba19067ccd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.146852 May 10 14:21:33.347208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 299/595] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:33 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:33.972610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:33.973262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:33.979682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.980128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:33.980890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.981321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.039389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:34.047563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21923ae1-01a1-4530-afef-22d3ee0e7498 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.078509 May 10 14:21:34.048113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 297/596] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:33 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:34.159796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:34.160408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:34.167433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.167883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.168659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.169095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.363940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:34.364581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:34.371609 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.372058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.372841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.373300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.519798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:34.529109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:34.530641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:34.531818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3455401-ada7-41d2-85d5-0127ea9fef6a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.375953 May 10 14:21:34.532597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 300/597] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:34 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:34.606842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:34.614219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db65e0ec-a3a8-4499-8f1b-2ff947ffdde2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.254236 May 10 14:21:34.614836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 298/598] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:34 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:35.064738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:35.065270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:35.071601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.072650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.073414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.073849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.133586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:35.141885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f8ab4054-9def-48d0-86f2-183c9cbddf70 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.081009 May 10 14:21:35.142476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 301/599] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:35 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:35.551165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:35.551765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:35.558414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.558862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.559654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.560086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.631264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:35.632488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:35.639892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.640345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.641124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.641558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.715283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:35.728501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:35.729995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:35.731162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eafa1eed-0f21-463a-8d32-81777b19e865 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.184350 May 10 14:21:35.731703 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 299/600] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:35.786424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:35.794325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-695ee657-962c-40a5-862c-c6b0ca955ae5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.166861 May 10 14:21:35.794886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 302/601] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:35 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:36.157917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:36.158561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:36.164438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.164892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.165697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.166118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.226348 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:36.234650 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15aa8b7e-cf4c-4644-99e9-ddea2d2cf510 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.080616 May 10 14:21:36.235192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 300/602] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:36 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:36.749211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:36.749824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:36.756105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.756559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.757321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.757756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.811932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:36.812544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:36.818473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.818927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.820209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.820209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.927417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:36.936472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:36.938652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:36.939892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-862837f1-4b6c-4b76-9237-8f74a7416bee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.194482 May 10 14:21:36.940460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 303/603] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:36.974392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:36.982180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-854c64df-ef37-4028-ba50-d228dc9d8f20 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.174194 May 10 14:21:36.982763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 301/604] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:36 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:37.256782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:37.257448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:37.264333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:37.264777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:37.265555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:37.265995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:37.334432 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:37.342229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-12af44b2-e63e-4b3e-95e2-dbe8af747e25 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.093028 May 10 14:21:37.342818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 304/605] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:37 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:38.000593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:38.001237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:38.010649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:38.011102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:38.011893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:38.013094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:38.063264 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:38.063866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:38.069853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:38.070327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:38.071089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:38.072378 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:38.190936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:38.199203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-35da1a7e-47b6-4e52-bbc6-796e8e1790c6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.203489 May 10 14:21:38.200013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 305/606] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:37 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:38.226816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:38.235187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:38.236756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:38.237905 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7df7440f-3874-4573-b5c4-6f2847498779 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.281703 May 10 14:21:38.238488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 302/607] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:37 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:38.359040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:38.359649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:38.365545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:38.366000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:38.366791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:38.367227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:38.432149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:38.439766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ba75ad6-b100-49b1-a9d9-004a0b7a1fec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.084557 May 10 14:21:38.440336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 306/608] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:38 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:39.216858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:39.217497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:39.223395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:39.223840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:39.224610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:39.225043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:39.256843 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:39.257485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:39.264568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:39.265021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:39.265803 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:39.266263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:39.401901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:39.409163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-032d226b-0d88-4a29-93ad-3ff1706549e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.197205 May 10 14:21:39.410017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 303/609] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:39 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:39.424285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:39.431996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:39.433501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:39.434681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5f0bbed3-53dc-4ff6-8ca0-1517cecf0594 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.181704 May 10 14:21:39.435236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 307/610] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:39 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:39.456609 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:39.457210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:39.463706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:39.464151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:39.464911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:39.465345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:39.528295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:39.535474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3cf48159-8366-42f2-9009-67b6acbc4a6f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.082690 May 10 14:21:39.536032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 304/611] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:39 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:40.425840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:40.426468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:40.433352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:40.433946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:40.435112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:40.435671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:40.454560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:40.455088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:40.460837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:40.461283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:40.462046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:40.463018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:40.629748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:40.637395 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9821d089-4179-4b58-a38a-a890b90447be tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.215532 May 10 14:21:40.637970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 308/612] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:40 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:40.643735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:40.648534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:40.649154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:40.652342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:40.653845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:40.655144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e5303a9-2aed-4d36-9702-18ec2f21c420 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.205202 May 10 14:21:40.655548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:40.655987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 305/613] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:40 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:40.656101 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:40.656771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:40.657210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:40.721718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:40.729118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-799f0d02-18dc-4569-81af-bd032ee2520f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.084294 May 10 14:21:40.729680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 309/614] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:40 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:41.654370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:41.654972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:41.660805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:41.661244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:41.661995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:41.662457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:41.674066 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:41.674725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:41.680957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:41.682143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:41.682941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:41.683382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:41.856900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:41.864530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-af01b4c3-0e26-415c-a059-7b6b85af2955 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.214349 May 10 14:21:41.865109 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 306/615] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:41 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:41.867552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:41.870081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:41.870715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:41.875982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:41.876453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:41.876929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:41.877497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:41.877722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:41.878147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:41.878710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-42709c8e-c0ed-4f64-9a0a-39ad58576383 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.208799 May 10 14:21:41.879271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 310/616] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:41 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:41.937345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:41.944453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6ab09f3-370f-4093-8297-a4497fc21d5d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.078407 May 10 14:21:41.945005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 307/617] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:41 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:42.880926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:42.881566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:42.887995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:42.888453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:42.889226 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:42.889668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:42.896620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:42.897248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:42.903768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:42.904214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:42.904984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:42.905416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:43.085270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:43.093386 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:43.093816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-37552a6d-dba8-4f4a-88fc-fe4720f5da56 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.216756 May 10 14:21:43.094420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 311/618] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:42 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:43.099114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:43.099911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:43.101293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:43.102829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:43.104494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c68e11ba-406e-4c87-99ec-b69bf92793c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.211185 May 10 14:21:43.104817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 308/619] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:42 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:43.106502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:43.106976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:43.107735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:43.108174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:43.168553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:43.175938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6f8e935-5379-43e0-a656-ce80441282e3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.080329 May 10 14:21:43.176501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 312/620] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:43 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:44.110982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:44.111593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:44.117403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:44.117859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:44.118664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:44.119088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:44.122498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:44.123113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:44.129463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:44.129917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:44.130728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:44.131162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:44.314192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:44.320844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:44.321467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b984e5dc-9c87-4220-bb33-fb79835d3f9c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.214341 May 10 14:21:44.322021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 309/621] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:44 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:44.326675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:44.327237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:44.329309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:44.330845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:44.331998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb4b20a8-4c01-4d66-a91e-b6dd2fa1d3cd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.213614 May 10 14:21:44.332546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 313/622] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:44 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:44.332779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:44.333223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:44.333985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:44.334442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:44.393773 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:44.402127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ae041b6-e503-42fe-96a2-5a22fc2bb4f0 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.077798 May 10 14:21:44.402711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 310/623] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:44 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:45.337971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:45.338794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:45.345089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:45.345623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:45.346422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:45.346859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:45.350679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:45.351284 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:45.357506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:45.357956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:45.358769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:45.359203 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:45.545686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:45.549039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:45.553496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b3a5d088-fdbd-463b-b561-9607ae731c00 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.219344 May 10 14:21:45.554150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 314/624] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:45 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:45.557728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:45.559663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:45.560836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0eeda480-6964-4523-84fc-8eaab799796f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.214000 May 10 14:21:45.561554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 311/625] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:45 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:45.563886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:45.564574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:45.571255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:45.571255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:45.578308 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:45.578308 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:45.635503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:45.642899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-de3c1f2a-3010-4af7-8978-1a1a3d6a3d38 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.083139 May 10 14:21:45.643466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 315/626] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:45 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:46.579842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:46.580491 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:46.584035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:46.584035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:46.586592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:46.587034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:46.587804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:46.588550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:46.591767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:46.592219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:46.592996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:46.593432 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:46.826765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:46.831430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:46.836161 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:46.838469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:46.839956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-058dd9f5-8d03-4dcd-90b7-22d9ced96509 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.264115 May 10 14:21:46.840811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 312/627] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:46 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:46.841428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-33911b68-d8db-4fe4-8409-73a66897d798 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.264539 May 10 14:21:46.845023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 316/628] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:46 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:46.846079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:46.846731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:46.855220 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:46.856136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:46.856937 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:46.857372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:46.925978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:46.936325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d54d24f-3dde-4407-a469-22126672ac66 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.094367 May 10 14:21:46.938495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 313/629] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:46 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:47.637412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-06b2abf7-e2e8-4098-8c85-30d9d8f56e30 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68eec7e8-9c72-4de7-8136-40d9cd5c3c67"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:47.638601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-06b2abf7-e2e8-4098-8c85-30d9d8f56e30 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:47.644482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06b2abf7-e2e8-4098-8c85-30d9d8f56e30 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:47.644925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06b2abf7-e2e8-4098-8c85-30d9d8f56e30 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:47.645679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06b2abf7-e2e8-4098-8c85-30d9d8f56e30 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:47.646112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06b2abf7-e2e8-4098-8c85-30d9d8f56e30 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:47.857648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:47.858173 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:47.864160 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:47.864602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:47.865362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:47.865795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:47.993559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:48.002026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:48.003562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:48.004697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a2bf1d1-7563-4884-a570-d29f0a9cfd64 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151178 May 10 14:21:48.005248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 314/630] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:48.009508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:48.010338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:48.017121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:48.017565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:48.018353 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:48.018786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:48.145740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:48.153863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa859757-81f4-471a-9860-dbc720560df9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.147667 May 10 14:21:48.154466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 315/631] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:48 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:48.158858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:48.159452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:48.165222 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:48.173795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:48.173795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:48.173795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:48.227788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:48.234988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6b46811f-1571-488e-bcc4-a77942f92b4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.079597 May 10 14:21:48.235936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 316/632] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:48 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:49.023599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:49.024219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:49.030771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:49.031217 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:49.031980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:49.032413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:49.160408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:49.168305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:49.169801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:49.170986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08735c91-4909-4afc-8447-4792fe5e31d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.151307 May 10 14:21:49.171533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 317/633] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:49.176145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:49.176738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:49.182937 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:49.183389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:49.184198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:49.184638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:49.312593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:49.319921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-507c07aa-7706-43d8-ad9f-6ff6277252e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.147444 May 10 14:21:49.320903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 318/634] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:49 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:49.327336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:49.327931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:49.333725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:49.334173 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:49.334967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:49.335401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:49.395346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:49.402587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-658e3812-74b9-47f7-9d48-68035f806809 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.080639 May 10 14:21:49.403156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 319/635] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:49 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:50.189310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:50.190081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:50.196578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:50.197020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:50.198858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:50.199456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:50.341950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:50.349824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:50.351367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:50.352517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7c0eae7-0060-48b0-aa0e-9f10e86dedfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.167192 May 10 14:21:50.353096 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 320/636] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:50 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:50.357649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:50.358315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:50.364060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:50.364553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:50.365311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:50.365736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:50.493096 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:50.500421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-12dd58cd-37ee-468d-b24f-cd8c93780b6b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.146372 May 10 14:21:50.500971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 321/637] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:50 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:50.505233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:50.505924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:50.512151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:50.512611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:50.513369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:50.513792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:50.574862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:50.582028 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9f332aa-28bf-4636-b69f-9a524245ae4e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.080142 May 10 14:21:50.582613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 322/638] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:50 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:51.371640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:51.372312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:51.378164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:51.378637 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:51.379389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:51.379811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:51.506085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:51.514359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:51.515891 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:51.517034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f655fbd1-e575-40f2-8c04-ba24ce842d05 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.150078 May 10 14:21:51.517581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 323/639] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:51 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:51.521950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:51.522563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:51.528202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:51.528647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:51.529420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:51.529852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:51.660091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:51.668452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d1197d8-761f-4f2a-94ec-243ef9ad0097 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.149916 May 10 14:21:51.669012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 324/640] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:51 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:51.673297 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:51.674138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:51.679608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:51.680046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:51.680901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:51.681419 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:51.740834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:51.748895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2832328b-e069-4922-9999-c77b240b8f36 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.078955 May 10 14:21:51.749452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 325/641] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:51 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:52.535194 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:52.535930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:52.542646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:52.543098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:52.543868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:52.544298 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:52.678387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:52.690684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:52.694125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:52.699705 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c91b38aa-a542-464b-8b66-9b8cdd935e6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.167046 May 10 14:21:52.707503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 326/642] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:52 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:52.707503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:52.707503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:52.714281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:52.715069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:52.715857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:52.716287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:52.850132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:52.857724 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5eba1c00-458b-4d1a-bee2-9a5acb737eef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.154830 May 10 14:21:52.859032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 327/643] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:52 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:52.863123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:52.863732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:52.869423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:52.869930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:52.870836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:52.871289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:52.937662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:52.945355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c93bc3d-c94f-4d12-9e70-93af9a3006d8 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1310 microversion: 2.1 time: 0.085709 May 10 14:21:52.954656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 328/644] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:52 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:53.723548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:53.726704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:53.734787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:53.735236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:53.736026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:53.736457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:53.874067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:53.882336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:53.884039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:53.885199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ef93bc0-9b43-4fc2-97a8-f0f006165b9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.168891 May 10 14:21:53.886003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 329/645] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:53 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:53.890790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:53.891379 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:53.897186 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:53.897893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:53.898712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:53.899192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:54.039077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:54.046615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c8e04729-7fb8-4631-a20f-e93c2df5b52f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.159380 May 10 14:21:54.047181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 330/646] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:53 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:54.052022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:54.052714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:54.059602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:54.060066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:54.061275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:54.061713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:54.125173 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:54.132569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d192f400-5eb5-47c9-abe4-9a552caadc79 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1318 microversion: 2.1 time: 0.084402 May 10 14:21:54.133124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 331/647] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:54 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1318 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:54.395954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-06b2abf7-e2e8-4098-8c85-30d9d8f56e30 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "POST /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.861736 May 10 14:21:54.396559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 317/648] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:21:47 2022] POST /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99/os-volume_attachments => generated 194 bytes in 6863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:54.905767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:54.907047 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:54.914035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:54.914726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:54.915412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:54.915844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:55.066931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:55.068267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:55.082283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:55.083055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:55.085832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:55.086659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:55.115965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:55.127813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:55.129587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:55.131165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-12b118fb-1d3c-469a-b37f-fe53a821c451 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.231745 May 10 14:21:55.143943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 332/649] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:54 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:55.163265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:55.168125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:55.176216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:55.176872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:55.177877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:55.178610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:55.327506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:55.336291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-687f7154-a9b8-48e7-b0cc-67f8f84e3a4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1316 microversion: 2.1 time: 0.191205 May 10 14:21:55.346271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 333/650] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:55 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:55.346271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-08220acc-7e54-40d5-9213-cb5062136b06 req-08eb1331-4ce0-4a7b-ba87-3408c9d0dc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a50ebb-7db2-481e-a381-14f2aa6f3ec9", "name": "network-vif-plugged", "status": "completed", "tag": "b322516a-ad64-4f70-89e2-1b69a91a3ade"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:55.349828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:55.351274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-08220acc-7e54-40d5-9213-cb5062136b06 req-08eb1331-4ce0-4a7b-ba87-3408c9d0dc95 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:55.356368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-08220acc-7e54-40d5-9213-cb5062136b06 req-08eb1331-4ce0-4a7b-ba87-3408c9d0dc95 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:55.359912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5c15a1e-47f1-4c06-94b6-9c4e70dbcaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.298301 May 10 14:21:55.360498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 318/651] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:55 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:55.368942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-08220acc-7e54-40d5-9213-cb5062136b06 req-08eb1331-4ce0-4a7b-ba87-3408c9d0dc95 service nova] Creating event network-vif-plugged:b322516a-ad64-4f70-89e2-1b69a91a3ade for instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 on hv-cinder-84112 May 10 14:21:55.369819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-08220acc-7e54-40d5-9213-cb5062136b06 req-08eb1331-4ce0-4a7b-ba87-3408c9d0dc95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 May 10 14:21:55.370497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 334/652] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:55.946448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bfa7c69d-4e54-4f5a-ac8b-11282652c66d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:55.954828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa7c69d-4e54-4f5a-ac8b-11282652c66d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:55.955987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa7c69d-4e54-4f5a-ac8b-11282652c66d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.034061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bfa7c69d-4e54-4f5a-ac8b-11282652c66d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Going to try to stop instance {{(pid=117661) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 14:21:56.156044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:56.157498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:56.164639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.165093 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.173446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.174493 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.265706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bfa7c69d-4e54-4f5a-ac8b-11282652c66d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/action" status: 202 len: 0 microversion: 2.1 time: 0.323074 May 10 14:21:56.266661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 319/653] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:21:55 2022] POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:21:56.277762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:56.278648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:56.284912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.285210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.285995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.286644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.430562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:56.441302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:56.444100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:56.445802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be037763-c3c9-4e26-8f32-5fb50a8bf896 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.299251 May 10 14:21:56.446710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 335/654] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:21:56.452024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:56.452787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:56.463379 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.465421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.466237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.467369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.552236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:56.560699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-32a8670f-d860-4b89-98f3-572c0c3888c5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.289433 May 10 14:21:56.561277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 320/655] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:56.576224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:56.576872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:56.583346 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.584028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.585177 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:56.585768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:56.641555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:56.648911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0640285e-0e58-41a3-893d-15dca92bda76 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.201082 May 10 14:21:56.649473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 336/656] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:56 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:56.751383 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:56.759872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0cd85b8e-09a2-40a3-86fb-138cd5b8303a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.188273 May 10 14:21:56.760450 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 321/657] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:56 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:57.465655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:57.467182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:57.473430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.473879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.474688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.475124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.578503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:57.579820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:57.586781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.587232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.588298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.588655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.626879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:57.639964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:57.641476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:57.642868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4db34ee-d140-406e-9a63-cf2ec947cb91 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.182061 May 10 14:21:57.644324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 337/658] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:57 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:57.666821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:57.668263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:57.674698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.675219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.676100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.676668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.819106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:57.837017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ced931ba-4558-4fe6-a9c6-dc027544e28f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.263980 May 10 14:21:57.841960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 322/659] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:57.850602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:57.851389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:57.852710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:57.862004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3537d8a3-97a1-47e7-a885-e82cee94eb4b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.199092 May 10 14:21:57.863516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.864069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.864963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:57.865523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:57.867089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 338/660] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:57 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:58.002726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:58.010373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d081eab0-bc60-48b7-b39e-58b13e2f84a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.167264 May 10 14:21:58.011680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 323/661] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:57 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:58.137664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-1ee57ffd-f01e-4276-94bd-0e886faa3445 req-14fbafa8-b1ce-413e-b6f5-a9dfde8ce4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340be81c-5d53-4810-9dff-18bcffaec607", "name": "network-vif-plugged", "status": "completed", "tag": "6454f1f1-341d-4a6d-a2c2-1a201b99484e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:58.146342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1ee57ffd-f01e-4276-94bd-0e886faa3445 req-14fbafa8-b1ce-413e-b6f5-a9dfde8ce4da service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:58.146932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1ee57ffd-f01e-4276-94bd-0e886faa3445 req-14fbafa8-b1ce-413e-b6f5-a9dfde8ce4da service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:58.160645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-1ee57ffd-f01e-4276-94bd-0e886faa3445 req-14fbafa8-b1ce-413e-b6f5-a9dfde8ce4da service nova] Creating event network-vif-plugged:6454f1f1-341d-4a6d-a2c2-1a201b99484e for instance 340be81c-5d53-4810-9dff-18bcffaec607 on hv-cinder-84112 May 10 14:21:58.165971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-1ee57ffd-f01e-4276-94bd-0e886faa3445 req-14fbafa8-b1ce-413e-b6f5-a9dfde8ce4da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033261 May 10 14:21:58.167121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 339/662] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:58.662391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:58.663048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:58.670349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:58.670854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:58.671749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:58.672199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:58.815716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:58.824261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:58.825794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:58.826985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e1da7e4d-a723-4cb0-88e3-8d6522b10f03 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.168610 May 10 14:21:58.827548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 324/663] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:21:58.856535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:58.857210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:58.863782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:58.864227 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:58.865005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:58.865441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:58.883248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:58.883989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:58.890576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:58.891089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:58.891938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:58.892434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:59.086116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:59.096573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:59.097692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d767a980-25a6-4a8b-99f2-847eb1853d29 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.245948 May 10 14:21:59.098802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 340/664] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:59.102710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:59.103305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:59.106951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cbd33567-aa14-4b8b-a049-b586bed04353 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.227441 May 10 14:21:59.109978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:59.110463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:59.111317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:59.111747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:59.117716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 325/665] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:58 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:59.256977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:59.266065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f067ad8-002b-460e-86ce-e6e894b986bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.166741 May 10 14:21:59.266681 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 341/666] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:21:59 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:59.845766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:59.846374 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:59.852695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:59.853141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:59.853902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:59.854383 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:59.991258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:00.001222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:00.002853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:00.004007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-227d97b3-e551-4981-b6fc-649b0071b677 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.162342 May 10 14:22:00.004576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 326/667] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:21:59 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:00.116368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:00.116922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:00.123890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:00.124333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:00.124790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:00.125104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:00.125426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:00.125531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:00.131271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:00.131716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:00.132483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:00.132918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:00.324362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:00.333321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97dbe98d-00ca-4205-b8ed-a4305e3e6485 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.220855 May 10 14:22:00.334192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 342/668] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:00.335042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:00.341872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:00.342763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:00.344234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c55a29fa-0b65-45f9-ba23-2e3307bcae8d tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.223772 May 10 14:22:00.344810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 327/669] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:00 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:00.349236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:00.349758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:00.350645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:00.351149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:00.486530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:00.493875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0649f321-a255-4375-b7f1-d33ba0e05624 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.157951 May 10 14:22:00.494461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 343/670] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:00 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:01.022055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:01.022639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:01.032329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.033128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.034140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.034657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.178224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:01.186945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:01.188449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:01.189616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7df6f897-7675-442e-a554-f295b98edbe5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.171513 May 10 14:22:01.190394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 328/671] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:01.351743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:01.352326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:01.358551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.358993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.359754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.360180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.360790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:01.361401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:01.367194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.367652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.368617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.368934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.568592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:01.578977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e359b77e-8149-48e3-96ec-6cda202890db tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.230948 May 10 14:22:01.579561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 344/672] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:01.583303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:01.585915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:01.586896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:01.593701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.594184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.595014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:01.595452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:01.610139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce9db90f-a6a2-46f2-82a7-46ad6997bd80 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.252925 May 10 14:22:01.610957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 329/673] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:01 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:01.735736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:01.743225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8bccc19-1e45-4050-85c3-bcd5ca0ae717 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.162670 May 10 14:22:01.743801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 345/674] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:01 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:02.216120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:02.216715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:02.223265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.223711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:02.224484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.224919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:02.370952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:02.379195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:02.380704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:02.381902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a01b9432-1ab6-448f-8b2b-c9d499a8a7af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.170412 May 10 14:22:02.382514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 330/675] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:02.596241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:02.596872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:02.602939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.603395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:02.604187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.604625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:02.629342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:02.631981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:02.639774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.641241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:02.642395 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.643129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:02.869513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:02.879057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6dddee5c-dbeb-472a-aaec-68e7ad62f326 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.286760 May 10 14:22:02.882274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:02.884518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 346/676] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:02.890468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:02.891081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:02.895516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eff65977-2719-4773-b396-ebb27116b94e tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.271538 May 10 14:22:02.896431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 331/677] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:02 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:02.908716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.910784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:02.911923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:02.912693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:03.064740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:03.073863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91cebab1-329f-42bb-9301-4a12c1fd3842 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.188106 May 10 14:22:03.073863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 347/678] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:02 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:03.400302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:03.400916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:03.408253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:03.408715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:03.409501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:03.409940 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:03.567673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:03.579717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:03.581354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:03.585125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5b0f849-b6a0-4451-8833-8e25ea0092d0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.186277 May 10 14:22:03.585769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 332/679] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:03 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:03.902857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:03.903443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:03.911866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:03.912605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:03.913244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:03.913676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:03.920319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:03.921040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:03.927413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:03.927834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:03.930305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:03.930858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:04.134911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:04.144590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a3e71b1-621c-470e-994f-d269726d5c22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.246553 May 10 14:22:04.145813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 348/680] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:04.148846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:04.152172 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:04.153030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:04.157498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-329fe734-e1fb-487d-b5f6-92f8eb866661 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.247087 May 10 14:22:04.158725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 333/681] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:03 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:04.161152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:04.161931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:04.162914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:04.163503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:04.308825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:04.316880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab11b93a-b837-473e-9c75-4e4418c2f02a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.169742 May 10 14:22:04.317593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 349/682] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:04 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:04.606099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:04.606922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:04.613367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:04.619163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:04.620001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:04.620587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:04.771381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:04.779826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:04.781312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:04.783295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a2872358-c503-4162-9ee2-2640efd61e8f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.182669 May 10 14:22:04.784017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 334/683] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:04 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:05.164553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:05.165268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:05.172263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.172800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.173654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.174164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.180953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:05.182166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:05.192361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.192821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.193997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.194166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.381887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:05.383281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:05.387066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0eea5b80-da77-4fed-9218-022b3f6b07ab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.225874 May 10 14:22:05.387944 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 350/684] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:05.392555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:05.393156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:05.399117 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.399513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.400280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.400714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.401899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e03c28a3-a71e-42cd-8779-1561eb94e2d6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.230237 May 10 14:22:05.414989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 335/685] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:05 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:05.540144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:05.548533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3a9be41e-2424-433b-9d5a-be6e7b7a15b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.159635 May 10 14:22:05.549542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 351/686] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:05 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:05.803295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:05.803934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:05.810703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.811138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.817914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:05.817914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:05.956053 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:05.965042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:05.966859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:05.968048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e678afd7-f46f-4cd7-b6f3-26e26975fea5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.169507 May 10 14:22:05.968887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 336/687] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:06.404999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:06.405731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:06.411716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.412158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:06.412921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.413347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:06.422299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:06.422914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:06.428911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.429364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:06.430130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.430589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:06.604324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:06.612965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:06.613114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46d6458e-0ca4-499d-8218-a5db58081ffb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.212671 May 10 14:22:06.613612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 352/688] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:06.619449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:06.620052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:06.620183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d56ced2-6f40-4e22-b6f4-66a999d9c73c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.201558 May 10 14:22:06.627500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 337/689] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:06 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:06.627676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.627676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:06.627676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.627676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:06.770176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:06.778069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4562c4fd-d479-4c63-85d7-088c57191e4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.163536 May 10 14:22:06.778653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 353/690] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:06 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:06.987743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:06.988351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:06.994687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.995131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:06.995897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:06.996324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:07.123647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:07.131297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:07.132778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:07.133917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-382434d3-b20e-471f-ac63-4c4b69f22804 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.150146 May 10 14:22:07.134497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 338/691] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:06 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:07.630424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:07.631122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:07.637465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:07.637780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:07.638085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:07.638253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:07.639024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:07.639453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:07.644262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:07.644720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:07.645526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:07.646105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:08.031675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:08.045785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:08.046320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a626afe-957b-4e0c-a1cd-8877a89cc3df tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.413266 May 10 14:22:08.046320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 354/692] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:08.046320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:08.046320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:08.046668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e11b7896-9fef-4e10-b13f-9bdb5464d3c2 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.412797 May 10 14:22:08.046917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 339/693] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:07 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:08.052608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:08.053203 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:08.054077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:08.054605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:08.153371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:08.154178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:08.160031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:08.162858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:08.162858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:08.162858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:08.189554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:08.197206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e31e482-b96b-4a16-8239-5255ccf0bdc5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.155882 May 10 14:22:08.197771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 355/694] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:08 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:08.300794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:08.308736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:08.310272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:08.311432 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-41e7ce01-9c5d-4a5d-8b8e-21c83d51210a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.162506 May 10 14:22:08.312003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 340/695] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:08 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:09.062099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:09.062664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:09.063330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:09.063938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:09.068635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.069089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.069858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.070073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.070313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.070620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.071414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.071843 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.264633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:09.271498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:09.273830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-26e0a4ad-e1bd-431f-a54c-ebbcdecc1480 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.216262 May 10 14:22:09.275234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 356/696] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:09.284725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:09.285344 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:09.286400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a02131f0-b308-40d5-b053-ce8f30427d01 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.226674 May 10 14:22:09.287222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 341/697] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:09 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:09.292043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.293272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.294539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.294984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.329161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:09.329775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:09.335776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.336224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.337001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:09.338330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:09.486484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:09.495182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89f12998-befc-46f1-8804-e48be7c29a6c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.219541 May 10 14:22:09.496714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 357/698] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:09 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:09.510900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:09.519831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:09.521338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:09.522580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e0f05a3e-426c-4225-848f-a5e10502ae6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.197472 May 10 14:22:09.523138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 342/699] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:09 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:10.293912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:10.294630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:10.300873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.301333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.302175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.305897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.314499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-eda9b655-362c-44e7-8b27-94f4315aede4 req-c7fb889c-b005-48b5-928c-eaf39823be79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c832da78-9dc2-4711-9fb1-907ac8dd7ffb", "tag": "8d8a39d0-cb57-409d-acdc-1499da1a0722"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:22:10.326666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-eda9b655-362c-44e7-8b27-94f4315aede4 req-c7fb889c-b005-48b5-928c-eaf39823be79 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.327095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-eda9b655-362c-44e7-8b27-94f4315aede4 req-c7fb889c-b005-48b5-928c-eaf39823be79 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.338720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-eda9b655-362c-44e7-8b27-94f4315aede4 req-c7fb889c-b005-48b5-928c-eaf39823be79 service nova] Creating event network-changed:8d8a39d0-cb57-409d-acdc-1499da1a0722 for instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb on hv-cinder-84112 May 10 14:22:10.345322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-eda9b655-362c-44e7-8b27-94f4315aede4 req-c7fb889c-b005-48b5-928c-eaf39823be79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094303 May 10 14:22:10.348874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 358/700] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:22:10.354681 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:10.356283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:10.363221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.363662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.364427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.365330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.514094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:10.522127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46ef8603-a879-41fd-87a4-7cd412e49604 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.234208 May 10 14:22:10.522889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 343/701] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:10.539319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:10.539561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:10.540135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:10.546776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.547224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.547608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c606320b-2f9c-4255-b197-5f0aefde8906 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.197344 May 10 14:22:10.548026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.548459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.548588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 359/702] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:10 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:10.553153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:10.553754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:10.560168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.560619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.561398 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:10.561833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:10.742236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:10.749225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:10.749506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6c7dc0f-86c7-49e5-aedf-1e81e74a5e3f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.225621 May 10 14:22:10.750444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 344/703] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:10 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:10.757089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:10.758644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:10.759762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0cb5d6d-6c9c-4cbd-8c61-ba9d3b310061 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.210395 May 10 14:22:10.760304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 360/704] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:10 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:11.539462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:11.540133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:11.553185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.553185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.553574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.554017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.565292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:11.565928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:11.572119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.572573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.573385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.574463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.754455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:11.763136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9e2a9f02-79a6-4a83-bded-2e9c1a24d88e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.227547 May 10 14:22:11.763810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 345/705] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:11 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:11.767769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:11.768421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:11.769026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:11.774681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.775134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.775242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebb6b0d3-09df-403f-8cba-ca93b8e9cfd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.213930 May 10 14:22:11.776156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 361/706] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:11 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:11.778324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.778792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.781893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:11.782526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:11.788364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.789016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.789791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:11.790310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:11.984178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:11.987377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:11.991713 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f3f23aa-9ce0-48d7-a863-6bb4764d8927 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1267 microversion: 2.1 time: 0.226852 May 10 14:22:11.992403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 346/707] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:11 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:11.995914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:11.997612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:11.998791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a52d4de-8500-4fc9-b017-e9e5997cf0f1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1744 microversion: 2.20 time: 0.220675 May 10 14:22:11.999336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 362/708] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:11 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:12.781787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:12.782884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:12.790782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:12.791234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:12.792004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:12.792442 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:12.792442 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:12.792638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:12.800185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:12.800623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:12.801389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:12.801815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:12.989695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:12.992534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:12.998719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-27818169-ae3d-4a54-a939-6627060e2f22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.222392 May 10 14:22:12.999299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 347/709] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:13.000732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f0811a19-4391-4fce-b2d0-469207daa9ec tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.212553 May 10 14:22:13.001282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 363/710] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:12 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:13.008432 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:13.009110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:13.015615 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:13.016143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:13.016830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:13.017048 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:13.017264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:13.017767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:13.023461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:13.023903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:13.024658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:13.025086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:13.214470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:13.218936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:13.222904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f7acc37f-8318-4bfd-9f45-8f16ba795c72 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1454 microversion: 2.1 time: 0.217708 May 10 14:22:13.227528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:13.229042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:13.230279 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8feace0e-6d5d-4546-84e4-1d3c0c1942ad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.217601 May 10 14:22:13.230906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 364/711] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:13 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:13.254926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 348/712] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:13 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1454 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:13.270601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:13.271208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:13.277307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:13.278660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:13.279610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:13.280204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:13.414994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:13.423454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-713b8ac4-436f-4c55-af3c-9e67d6f5dcea tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1454 microversion: 2.1 time: 0.156578 May 10 14:22:13.424029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 365/713] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:13 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:14.017201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:14.017814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:14.018114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:14.018750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:14.026187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:14.027980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:14.031070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:14.031786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:14.036595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:14.037045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:14.037837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:14.038296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:14.301400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:14.309313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08348ff0-3d9c-4614-9814-76e3b53a658b tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.294786 May 10 14:22:14.319597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 366/714] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:14 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:14.320897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:14.325505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:14.326484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:14.331478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4bc90624-81bb-45cb-bc40-1c255de1f70c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.318942 May 10 14:22:14.332595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 349/715] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:14 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:14.332909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:14.333420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:14.334410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:14.334984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:14.663518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:14.683619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:14.685733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:14.695325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06099ecc-9d96-4846-a39e-dc654dd898b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.374419 May 10 14:22:14.696134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 367/716] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:15.327036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:15.328390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:15.335095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:15.335890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:15.336896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:15.337539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:15.354069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:15.355533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:15.364285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:15.365055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:15.366643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:15.367418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:15.850490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:15.870078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ba7ad54-c206-40d3-884b-d0ffe439d0e9 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.537611 May 10 14:22:15.870078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 350/717] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:15 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:15.870078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:15.870078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:15.873409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:15.883699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d83309dc-8325-4ba0-8a1a-02fe69dbee6c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.536708 May 10 14:22:15.888127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 368/718] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:15.909125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:15.909507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:15.910319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:15.910784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:16.153646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:16.166459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:16.167906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:16.169402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9e0e1102-7180-4a78-8151-6c99da6fffa4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.307144 May 10 14:22:16.170841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 351/719] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:15 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:16.670807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-f0b1bfa9-f9c3-4f34-8edf-f3a240b2e4a7 req-df428879-59bf-4ee3-abbb-c69a20d1b45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340be81c-5d53-4810-9dff-18bcffaec607", "tag": "6454f1f1-341d-4a6d-a2c2-1a201b99484e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:22:16.685292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f0b1bfa9-f9c3-4f34-8edf-f3a240b2e4a7 req-df428879-59bf-4ee3-abbb-c69a20d1b45d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:16.686151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f0b1bfa9-f9c3-4f34-8edf-f3a240b2e4a7 req-df428879-59bf-4ee3-abbb-c69a20d1b45d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:16.713199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-f0b1bfa9-f9c3-4f34-8edf-f3a240b2e4a7 req-df428879-59bf-4ee3-abbb-c69a20d1b45d service nova] Creating event network-changed:6454f1f1-341d-4a6d-a2c2-1a201b99484e for instance 340be81c-5d53-4810-9dff-18bcffaec607 on hv-cinder-84112 May 10 14:22:16.726053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-f0b1bfa9-f9c3-4f34-8edf-f3a240b2e4a7 req-df428879-59bf-4ee3-abbb-c69a20d1b45d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129516 May 10 14:22:16.727238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 369/720] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:22:16.877264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:16.877873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:16.886602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:16.908823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:16.908823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:16.908823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:16.909119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:16.909119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:16.916731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:16.923855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:16.924729 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:16.925439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:17.132558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:17.135687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:17.145690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bc45aa56-01b2-4cc5-9252-c8dbcfda399f tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.272264 May 10 14:22:17.146268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d824fdb-183f-4dde-aec4-c07a3a7f3e6b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.244765 May 10 14:22:17.146497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 352/721] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:16 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:17.147020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 370/722] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:17.188202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:17.188919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:17.194909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:17.195437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:17.196441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:17.196974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:17.361281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:17.371292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:17.374028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:17.375931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cb8adcc8-4e77-47e6-8857-c23e698971ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.192533 May 10 14:22:17.377204 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 353/723] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:17 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:18.163624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:18.164234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:18.171584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:18.172037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:18.172887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:18.173604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:18.178956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:18.181448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:18.181911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:18.182530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:18.183466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:18.184130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:18.445666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:18.449234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:18.455139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-731f9b33-aefa-40e3-9e84-931607c64a13 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.286904 May 10 14:22:18.460290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b022ef6-5d6c-4364-bae5-ab140c1bfde9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.300418 May 10 14:22:18.462374 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 354/724] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:18 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:18.473625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:18.474060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 371/725] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:18.474962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:18.483525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:18.485001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:18.486749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:18.487299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:18.665227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:18.675524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:18.677439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:18.681826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e9b31d4-7aba-4872-840b-583ba3eab690 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.217765 May 10 14:22:18.692774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 355/726] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:18 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:19.481100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:19.488947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:19.489938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:19.495171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:19.501703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:19.501911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:19.502513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:19.503265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:19.503500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:19.504173 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:19.504551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:19.505258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:19.722963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:19.724827 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:19.733341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f750f1f7-b1c1-4dcf-aa95-c2f0f0ffc78a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.260903 May 10 14:22:19.735278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fd059422-f3ad-4a28-9d3a-cf35e3127be3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.258281 May 10 14:22:19.744684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 356/727] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:19.744900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 372/728] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:19 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:19.745116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:19.745637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:19.752092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:19.752497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:19.753287 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:19.753731 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:19.895642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:19.910777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:19.912764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:19.915496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-06cda29d-6d67-4157-9bd1-8c4e521f9b97 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.178683 May 10 14:22:19.926936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 357/729] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:19 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:20.547968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-738d4647-c0bc-40bb-8d07-4bf8b2eee47c req-4ccc009c-e40b-4c9e-91f2-08a9d20df6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c832da78-9dc2-4711-9fb1-907ac8dd7ffb", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a39d0-cb57-409d-acdc-1499da1a0722"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:22:20.562287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-738d4647-c0bc-40bb-8d07-4bf8b2eee47c req-4ccc009c-e40b-4c9e-91f2-08a9d20df6a5 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:20.563069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-738d4647-c0bc-40bb-8d07-4bf8b2eee47c req-4ccc009c-e40b-4c9e-91f2-08a9d20df6a5 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:20.584385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-738d4647-c0bc-40bb-8d07-4bf8b2eee47c req-4ccc009c-e40b-4c9e-91f2-08a9d20df6a5 service nova] Creating event network-vif-plugged:8d8a39d0-cb57-409d-acdc-1499da1a0722 for instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb on hv-cinder-84112 May 10 14:22:20.594464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-738d4647-c0bc-40bb-8d07-4bf8b2eee47c req-4ccc009c-e40b-4c9e-91f2-08a9d20df6a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134679 May 10 14:22:20.595626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 373/730] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:22:20.754309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:20.755075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:20.762554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:20.764620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:20.765968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:20.766458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:20.767743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:20.768370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:20.772527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:20.773013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:20.773796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:20.774244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:20.978775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:20.988013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2480f56f-2ce1-42cb-b85f-63a3d17e5236 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.238581 May 10 14:22:20.990175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 358/731] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:20 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:20.993551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:20.994291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:21.000677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:21.001140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:21.002162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:21.002635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:21.014847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:21.036407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d09919fa-95c7-4938-8c81-cfb799d277d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.279774 May 10 14:22:21.037366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 374/732] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:21.140422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:21.148929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:21.150454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:21.151611 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-077e5090-82ad-41c0-a7da-9e110295a1e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.161997 May 10 14:22:21.152176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 359/733] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:20 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:22.004930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:22.006304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:22.012782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:22.013470 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:22.014154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:22.014614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:22.055228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:22.056023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:22.064450 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:22.065049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:22.065946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:22.066534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:22.213147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:22.222400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ab211c7-80fd-4bd3-812b-eedeabb76997 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.221121 May 10 14:22:22.223558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 375/734] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:21 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:22.228890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:22.229765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:22.238383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:22.239400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:22.240598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:22.241264 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:22.295850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:22.306558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ccec2fdf-9b1a-4eec-a4ff-68ba82a44044 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.256355 May 10 14:22:22.318110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 360/735] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:22 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:22.404061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:22.412765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:22.414343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:22.415508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8bee6959-e6fa-4055-a131-b2aa7ceeaa6d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.190618 May 10 14:22:22.416206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 376/736] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:23.240004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:23.240719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:23.247610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:23.248068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:23.248844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:23.249281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:23.330180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:23.332830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:23.340763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:23.341563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:23.343088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:23.343088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:23.440877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:23.460847 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0486871b-299c-42d1-b7a0-536a1a60345a tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1358 microversion: 2.1 time: 0.224532 May 10 14:22:23.471619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 361/737] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:23 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:23.476910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:23.477738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:23.484720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:23.485510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:23.486494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:23.487095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:23.507676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:23.519093 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d1d2a61-19bd-4505-9afe-317e1c6b1847 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.198023 May 10 14:22:23.520187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 377/738] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:23.658457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:23.670677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:23.672580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:23.674136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc06c8d1-3e78-4e1f-9430-4dceb47be96e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.201083 May 10 14:22:23.687734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 362/739] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:23 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:24.479071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:24.479627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:24.486097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.486592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.487342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.487805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.537351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:24.537961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:24.545387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.545831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.546627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.547488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.691026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:24.710342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ec65835-14eb-4479-9094-73bbe28807f5 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1548 microversion: 2.1 time: 0.223509 May 10 14:22:24.710342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 378/740] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:24 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:24.710342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:24.710342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:24.715336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.716346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.717539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.717978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.734443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:24.742402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd6b8404-4a1a-46f2-926d-264ad8109237 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1722 microversion: 2.1 time: 0.208794 May 10 14:22:24.743074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 363/741] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:22:24.747981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:24.748689 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:24.754593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.755124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.755972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.756485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.901931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:24.911167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:24.912704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:24.914030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9cb02248-2f1f-4439-8428-cb052fae784c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.213591 May 10 14:22:24.914617 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 379/742] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:24 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:24.926594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:24.933999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bbb55e0c-eeb9-4659-94a4-eded69a4a541 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1548 microversion: 2.1 time: 0.189905 May 10 14:22:24.934628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 364/743] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:24 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:24.954295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:24.957734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:24.958522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Searching by: {'deleted': False, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85'} {{(pid=117660) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 14:22:24.965123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.965576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:24.973665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:24.974601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.066963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.multi_cell_list [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117660) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 14:22:25.172771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-908df8da-0c96-43d2-97bf-05e1f8881448 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.223760 May 10 14:22:25.173356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 380/744] 10.222.0.58 () {58 vars in 1124 bytes} [Tue May 10 14:22:24 2022] GET /compute/v2.1/servers => generated 343 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:22:25.184476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:25.185629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:25.193059 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:25.193535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.194343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:25.194779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.391568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:25.400836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2984f5f7-6f4c-48a0-8dde-cee2cc9d4ac3 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1548 microversion: 2.1 time: 0.220603 May 10 14:22:25.402660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 365/745] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:25 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:25.760394 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:25.761014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:25.767730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:25.768175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.768940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:25.769379 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.898249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:25.906789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87f2c699-e8f1-4e72-8275-70d0c52af511 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1699 microversion: 2.1 time: 0.150458 May 10 14:22:25.907355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 381/746] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:25.923224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5e4fecde-9436-4887-978d-74e75b63b494 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:22:25.930040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4fecde-9436-4887-978d-74e75b63b494 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:25.930526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4fecde-9436-4887-978d-74e75b63b494 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.932569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:25.933190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:25.939180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:25.939630 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.941277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:25.941277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:25.958600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5e4fecde-9436-4887-978d-74e75b63b494 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Going to try to start instance {{(pid=117661) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 14:22:26.077769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:26.087119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:26.088649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:26.089781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ca31986-fa37-4a52-bcc5-05d701c4bbc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.161068 May 10 14:22:26.090345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 382/747] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:25 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:26.180913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5e4fecde-9436-4887-978d-74e75b63b494 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/action" status: 202 len: 0 microversion: 2.1 time: 0.261579 May 10 14:22:26.181929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 366/748] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:22:25 2022] POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:22:26.190896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:26.191903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:26.197690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:26.198138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:26.198978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:26.199410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:26.350656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:26.359270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d898cc6-73c9-4f3f-9324-db0a960f97f9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1708 microversion: 2.1 time: 0.172424 May 10 14:22:26.359848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 383/749] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:27.109409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:27.110052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:27.117182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:27.117633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:27.118435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:27.118866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:27.254227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:27.262160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:27.263730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:27.264871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2fb8507a-47d7-40a3-87d0-ffbe5aacba76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1739 microversion: 2.20 time: 0.160082 May 10 14:22:27.265955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 367/750] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:27 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:27.377152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:27.378585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:27.387710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:27.387710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:27.387710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:27.387710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:27.519092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:27.526833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f68ef884-8d41-4008-bb22-8406fd47794c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1708 microversion: 2.1 time: 0.154642 May 10 14:22:27.527388 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 384/751] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:28.282628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:28.283219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:28.289523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:28.289976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:28.290805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:28.291245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:28.420881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:28.428864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:28.430407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:28.431550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa87ad0c-15c2-4230-b9d1-9c8f9107b916 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1721 microversion: 2.20 time: 0.152807 May 10 14:22:28.437200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 368/752] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:28.544880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:28.547152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:28.554339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:28.554799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:28.555652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:28.556084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:28.740492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:28.748528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-797762de-082a-4b93-9517-909bc9685dfe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1708 microversion: 2.1 time: 0.207611 May 10 14:22:28.749094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 385/753] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1708 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:29.450403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:29.451110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:29.457347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:29.457796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:29.458608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:29.459233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:29.613386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:29.621533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:29.623701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:29.624968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d96264ee-bfbf-45b7-bdd3-8f33733b1c3e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1721 microversion: 2.20 time: 0.178763 May 10 14:22:29.625525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 369/754] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:29 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:29.766053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:29.766671 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:29.773615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:29.774066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:29.777024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:29.777024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:29.927442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:29.935421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3dd2115-73ea-4118-b6ab-2ed6d2ee1191 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1712 microversion: 2.1 time: 0.173803 May 10 14:22:29.935982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 386/755] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:22:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1712 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:22:30.357146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-166e1eb6-9c27-400a-a203-f9363e6f9b2a req-89f3245d-6470-476c-b3e9-c928155c584a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a50ebb-7db2-481e-a381-14f2aa6f3ec9", "name": "network-vif-unplugged", "status": "completed", "tag": "b322516a-ad64-4f70-89e2-1b69a91a3ade"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:22:30.366046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-166e1eb6-9c27-400a-a203-f9363e6f9b2a req-89f3245d-6470-476c-b3e9-c928155c584a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:30.366830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-166e1eb6-9c27-400a-a203-f9363e6f9b2a req-89f3245d-6470-476c-b3e9-c928155c584a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:30.377726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-166e1eb6-9c27-400a-a203-f9363e6f9b2a req-89f3245d-6470-476c-b3e9-c928155c584a service nova] Creating event network-vif-unplugged:b322516a-ad64-4f70-89e2-1b69a91a3ade for instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 on hv-cinder-84112 May 10 14:22:30.382769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-166e1eb6-9c27-400a-a203-f9363e6f9b2a req-89f3245d-6470-476c-b3e9-c928155c584a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033433 May 10 14:22:30.383386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 370/756] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:22:30.643987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:30.644595 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:30.650527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:30.650979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:30.651748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:30.652183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:30.787925 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:30.796470 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:30.797961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:30.799132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b82c53ae-1b3b-477d-9d86-050413e4d9fa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1724 microversion: 2.20 time: 0.159026 May 10 14:22:30.799683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 387/757] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:30 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:30.817642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2720cda4-18fb-473c-be39-236182641931 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "224d5959-b38b-4840-aaf0-0dd55d2a06ff"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:22:30.818868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2720cda4-18fb-473c-be39-236182641931 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:30.825722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2720cda4-18fb-473c-be39-236182641931 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:30.826410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2720cda4-18fb-473c-be39-236182641931 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:30.827254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2720cda4-18fb-473c-be39-236182641931 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:30.827634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2720cda4-18fb-473c-be39-236182641931 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:31.874635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2720cda4-18fb-473c-be39-236182641931 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "POST /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.061326 May 10 14:22:31.875338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 371/758] 10.222.0.58 () {62 vars in 1363 bytes} [Tue May 10 14:22:30 2022] POST /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments => generated 188 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:22:32.001210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1caf9e9f-0336-4fa5-8890-20424c70d9c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:22:32.001776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1caf9e9f-0336-4fa5-8890-20424c70d9c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:32.008247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1caf9e9f-0336-4fa5-8890-20424c70d9c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:32.008697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1caf9e9f-0336-4fa5-8890-20424c70d9c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:32.009471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1caf9e9f-0336-4fa5-8890-20424c70d9c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:32.009914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1caf9e9f-0336-4fa5-8890-20424c70d9c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:32.283279 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1caf9e9f-0336-4fa5-8890-20424c70d9c8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "POST /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/action" status: 202 len: 0 microversion: 2.20 time: 0.286417 May 10 14:22:32.284464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 388/759] 10.222.0.58 () {62 vars in 1318 bytes} [Tue May 10 14:22:31 2022] POST /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:22:32.292618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:32.293266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:32.301594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:32.302130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:32.303532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:32.304063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:32.453700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:32.463320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:32.464863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:32.466057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9ce31b07-ebaa-47c7-adbe-24c488858515 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1750 microversion: 2.20 time: 0.177406 May 10 14:22:32.466718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 372/760] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:33.485531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:33.486128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:33.492310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:33.492749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:33.493522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:33.495576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:33.633744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:33.652384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:33.655175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:33.656366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c4c0c582-9824-45e2-9973-9858b3ebfb9d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1750 microversion: 2.20 time: 0.175208 May 10 14:22:33.656919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 389/761] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:33 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:34.675259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:34.675876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:34.682604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:34.683075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:34.684158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:34.684447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:34.824792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:34.833697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:34.835235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:34.836419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f35d9bcb-e541-439b-99bf-8338de93654d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.165121 May 10 14:22:34.836971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 373/762] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:34 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:35.854175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:35.854798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:35.860790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:35.861239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:35.862002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:35.862457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:35.989467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:35.997568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:35.999571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:36.000700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d939a314-16f7-4691-a9cf-47d28eb0cca1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150374 May 10 14:22:36.001240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 390/763] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:37.019278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:37.019918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:37.026166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:37.026644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:37.027419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:37.027851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:37.171463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:37.179934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:37.181497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:37.182685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2a60f3c3-e5d4-43a8-846c-32293431fada tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.167305 May 10 14:22:37.183235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 374/764] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:37 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:38.200733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:38.201328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:38.207320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:38.207759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:38.208513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:38.209036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:38.338960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:38.348331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:38.349738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:38.350903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6767c122-8531-45b5-b274-726df87dfd50 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154097 May 10 14:22:38.351451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 391/765] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:38 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:39.369956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:39.370587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:39.377736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:39.378175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:39.378960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:39.379389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:39.515493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:39.523577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:39.525062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:39.526219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9d89180f-18d1-4a8d-813d-aa10cf2d867e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.160154 May 10 14:22:39.526763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 375/766] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:39 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:40.545664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:40.546904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:40.553320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:40.553791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:40.554582 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:40.555006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:40.684449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:40.692699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:40.694193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:40.695366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ade3496-125a-4c4d-a0a2-4da1925904e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153718 May 10 14:22:40.695914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 392/767] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:40 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:41.714393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:41.715037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:41.722069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:41.722542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:41.723304 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:41.724253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:41.850030 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:41.858221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:41.859976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:41.861127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-30668b14-df47-449d-9cb3-cd497c747f42 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150673 May 10 14:22:41.861682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 376/768] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:41 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:42.879355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:42.879953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:42.885863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:42.886335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:42.887089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:42.887514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:43.016337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:43.024468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:43.025943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:43.027099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-171e5dfd-dba7-4fed-a394-dd021d8003dd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151612 May 10 14:22:43.027643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 393/769] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:42 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:44.045887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:44.047368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:44.053917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:44.054411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:44.055179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:44.055612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:44.182156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:44.191223 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:44.192706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:44.193845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5cefda6c-7424-4d90-aee6-24a4804c9468 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151911 May 10 14:22:44.194422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 377/770] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:44 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:45.212265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:45.212863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:45.218719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:45.219436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:45.220094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:45.221260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:45.357857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:45.366513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:45.367994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:45.369137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2face1d-834b-40bb-a6f8-000d955de217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.160647 May 10 14:22:45.369688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 394/771] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:45 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:22:46.387698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:46.388335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:46.395044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:46.395493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:46.396260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:46.396697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:46.530084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:46.539216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:46.542353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:46.542353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-719aac91-73d6-4ee6-8fbe-192ad95294a5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.158174 May 10 14:22:46.542691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 378/772] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:46 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:47.564794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:47.565683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:47.571963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:47.572406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:47.573169 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:47.573593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:47.722314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:47.731082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:47.732587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:47.733739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c945305-cd75-4f33-aed0-3e46f105f341 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.176083 May 10 14:22:47.734298 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 395/773] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:48.754461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:48.755061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:48.763791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:48.764237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:48.765003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:48.765435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:48.897400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:48.905487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:48.907015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:48.908156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eec2acdf-6b5d-4f09-a46a-42d13963b883 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.157943 May 10 14:22:48.909848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 379/774] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:48 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:49.928105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:49.928689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:49.934784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:49.935239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:49.936041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:49.936511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:50.061679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:50.070449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:50.071972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:50.073115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-afc52b1e-8b23-419c-8ac0-99e4e2bbd49e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150055 May 10 14:22:50.073670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 396/775] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:51.091951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:51.092492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:51.099470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:51.099917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:51.100685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:51.101123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:51.234832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:51.243010 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:51.244484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:51.245627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-36d1bcb8-1272-425d-9d29-22e2b79f70f3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.157706 May 10 14:22:51.246181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 380/776] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:51 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:52.263529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:52.264143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:52.270105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:52.270578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:52.271344 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:52.271806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:52.401348 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:52.410408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:52.411898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:52.413029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4c78e5a2-5f94-4574-ba74-c73c6610fff9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153532 May 10 14:22:52.413562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 397/777] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:52 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:53.431388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:53.431994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:53.438306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:53.438758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:53.439520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:53.440728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:53.563794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:53.572640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:53.574134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:53.575333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d29f116f-242d-4111-95bd-4a41d59756b2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.148112 May 10 14:22:53.575888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 381/778] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:53 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:54.593946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:54.598612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:54.601188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:54.601633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:54.602438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:54.602869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:54.735164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:54.744031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:54.745503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:54.746666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-28884e70-092e-4210-ac59-3b7c354ae3b4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.156899 May 10 14:22:54.747206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 398/779] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:54 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:55.764021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:55.764632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:55.771046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:55.771491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:55.772258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:55.772692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:55.901699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:55.910948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:55.912437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:55.913584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5016d7cd-b0cc-467f-8236-1b6907b379a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153405 May 10 14:22:55.914132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 382/780] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:55 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:56.932340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:56.932921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:56.938901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:56.939350 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:56.940151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:56.940590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:57.068897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:57.076949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:57.078467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:57.079609 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0cb1c30b-28da-4db9-8512-37c3951ac983 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151458 May 10 14:22:57.080154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 399/781] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:58.099429 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:58.099893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:58.106065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:58.106565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:58.107345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:58.107787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:58.444472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:58.452729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:58.454293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:58.455503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a63f301f-d9b2-4a37-9bf2-062d6c911f59 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.360460 May 10 14:22:58.456208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 383/782] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:22:59.473768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:22:59.474314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:22:59.480142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:59.480591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:59.481340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:22:59.481766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:22:59.608357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:59.617190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:59.618714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:22:59.619865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b362a19-7b66-42d6-8add-831721225d27 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150045 May 10 14:22:59.620415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 400/783] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:22:59 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:00.638796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:00.639444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:00.646521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:00.646972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:00.647771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:00.648205 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:00.778596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:00.787088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:00.788614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:00.789793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2bbef101-aaaf-48c2-803d-5a55f3e8b9a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154902 May 10 14:23:00.790427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 384/784] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:00 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:01.808872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:01.809469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:01.815915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:01.816361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:01.817122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:01.817549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:01.945298 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:01.953539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:01.955067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:01.956825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e7e0cf2-7bbc-411d-9236-516d9870418b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151803 May 10 14:23:01.957373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 401/785] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:02.974475 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:02.975084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:02.981411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:02.981854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:02.982662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:02.983100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:03.115890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:03.124231 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:03.125731 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:03.126903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6c472e8-2718-4bbd-b4c0-8f09a53fbfc4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.157035 May 10 14:23:03.128185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 385/786] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:04.144806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:04.145404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:04.151789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:04.152265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:04.153060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:04.153498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:04.282467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:04.291522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:04.292985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:04.294115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5aea8ccd-5f37-4652-93e5-4a95e62c1dd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153331 May 10 14:23:04.294685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 402/787] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:04 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:05.313435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:05.314048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:05.321327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:05.321794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:05.322679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:05.323755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:05.454398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:05.462567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:05.464068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:05.465228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a0074f8b-5e18-443c-bd46-09f8e9fd83a6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155701 May 10 14:23:05.465795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 386/788] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:06.483543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:06.484082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:06.490002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:06.490474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:06.491231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:06.491688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:06.624234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:06.633472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:06.634992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:06.636130 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-990b1ff6-ce66-4a4d-9e8c-b0565e3ca652 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.156579 May 10 14:23:06.636666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 403/789] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:06 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:07.654891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:07.655500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:07.662974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:07.663419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:07.664192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:07.664623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:07.792595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:07.800900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:07.802478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:07.803899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3930866-6ccb-46d6-bdb6-a581f04eea96 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152636 May 10 14:23:07.804450 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 387/790] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:08.822933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:08.823559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:08.829349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:08.829788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:08.830571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:08.831779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:08.962297 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:08.970376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:08.972007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:08.973144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f460f6d-c3c1-482a-b1cd-b435d6c0954e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154135 May 10 14:23:08.973685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 404/791] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:08 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:09.991350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:09.991960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:09.998462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:09.998913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:09.999676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:10.000111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:10.126016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:10.134747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:10.136286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:10.137469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-29bf6aa5-2821-4c4a-81a5-f4d0cec68901 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150285 May 10 14:23:10.138021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 388/792] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:09 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:11.155674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:11.156270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:11.162589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:11.163034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:11.163812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:11.164241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:11.295823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:11.306159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:11.308038 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:11.309336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f3199a2-e892-4a63-8d9e-a8b38bfb6b68 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.157424 May 10 14:23:11.310362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 405/793] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:11 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:12.331515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:12.332214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:12.338663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:12.339112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:12.339880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:12.340316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:12.467671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:12.476359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:12.477897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:12.479091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6cf3a1de-3990-4eae-a564-6b55e8a81828 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151988 May 10 14:23:12.479775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 389/794] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:12 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:13.496629 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:13.497237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:13.503581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:13.504063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:13.504835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:13.505266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:13.634624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:13.643000 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:13.644757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:13.645903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e148484-5e97-4b86-90dc-6c58bf5fa1fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153148 May 10 14:23:13.646473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 406/795] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:13 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:14.664858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:14.665463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:14.671999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:14.672482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:14.673258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:14.673697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:14.803434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:14.811783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:14.813263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:14.814456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-52f427e1-90cf-4ebf-8f49-24b55b6b2763 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153445 May 10 14:23:14.815004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 390/796] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:15.834082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:15.834647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:15.840695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:15.841141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:15.841906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:15.842369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:15.965746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:15.974473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:15.976058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:15.977212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5de51745-8ca2-48d6-ad57-aa5e0633b09e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.147586 May 10 14:23:15.977767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 407/797] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:15 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:16.995737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:16.996289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:17.002176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:17.002650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:17.003911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:17.004342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:17.148065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:17.156234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:17.157715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:17.158895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-42d2881b-1d77-4f5f-b460-0c682686a541 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.167283 May 10 14:23:17.159950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 391/798] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:16 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:18.177967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:18.178626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:18.184723 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:18.185161 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:18.185921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:18.186379 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:18.313428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:18.322458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:18.323935 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:18.325071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4bac30a5-e2eb-4738-b063-a60b97f0a1c7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151674 May 10 14:23:18.325618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 408/799] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:18 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:19.343034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:19.343667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:19.350006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:19.350488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:19.351248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:19.351679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:19.487332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:19.495484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:19.496980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:19.498119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c05a46f9-fa68-465a-8074-3698f9809445 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.158982 May 10 14:23:19.498697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 392/800] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:19 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:20.517708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:20.517708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:20.524280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:20.524724 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:20.525490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:20.525920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:20.654643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:20.664095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:20.665568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:20.666739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac4ec3d8-d9de-4151-9bf3-08d3b565b9a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153626 May 10 14:23:20.667286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 409/801] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:20 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:21.685572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:21.686175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:21.692552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:21.692987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:21.693742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:21.694169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:21.820100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:21.828281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:21.829780 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:21.830975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-da16e216-298a-4475-a388-651c20087297 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.149330 May 10 14:23:21.831533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 393/802] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:21 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:22.850249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:22.850862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:22.856805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:22.857253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:22.858022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:22.858487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:22.991802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:23.000049 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:23.001542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:23.002725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc692b24-dec7-4f2f-8311-3ffe50b041d5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.156798 May 10 14:23:23.003261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 410/803] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:24.026902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:24.027500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:24.033753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:24.034212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:24.034980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:24.035422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:24.162914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:24.171200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:24.172806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:24.173952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-284c6d9b-0118-4fcf-b2dd-d4625f9521b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150917 May 10 14:23:24.174526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 394/804] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:24 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:25.194053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:25.194757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:25.200678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:25.201125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:25.201897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:25.202390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:25.332581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:25.341253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:25.343596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:25.343931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f3a7b3f8-b6d8-46a3-a222-e337280e7009 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154545 May 10 14:23:25.344468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 411/805] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:25 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:26.361939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:26.362523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:26.369402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:26.369857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:26.370662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:26.371103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:26.502510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:26.511239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:26.512768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:26.513942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b5acb205-4193-438b-a7a8-856abdf126db tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155948 May 10 14:23:26.514613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 395/806] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:26 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:27.539893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:27.540496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:27.547207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:27.547657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:27.548442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:27.548850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:27.676964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:27.685847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:27.687387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:27.688546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb80707c-6236-441e-b9de-449e624a3fb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152533 May 10 14:23:27.689094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 412/807] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:27 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:28.707495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:28.708099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:28.715051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:28.715501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:28.716266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:28.716701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:28.845571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:28.854228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:28.855657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:28.856889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa5bc23d-6d52-443b-91fa-c18f3d3ac2a8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153207 May 10 14:23:28.857436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 396/808] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:29.875509 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:29.876114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:29.882278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:29.882725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:29.883492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:29.883917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:30.010538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:30.018689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:30.020188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:30.021308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-04f54f68-888c-4dde-84e3-30216395e6e1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.149778 May 10 14:23:30.021891 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 413/809] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:29 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:31.040323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:31.040932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:31.047182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:31.047640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:31.048402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:31.048840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:31.181480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:31.189668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:31.191194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:31.192350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4bb8ad3e-eea3-4962-a40a-47198a3f4379 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.156236 May 10 14:23:31.192907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 397/810] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:31 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:32.212330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:32.212912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:32.218895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:32.219337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:32.220099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:32.220525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:32.349798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:32.358929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:32.360435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:32.361581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a8fde290-6cc3-40ca-bfce-311b22329696 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154350 May 10 14:23:32.362355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 414/811] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:33.380066 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:33.380676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:33.387537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:33.387986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:33.388751 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:33.389186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:33.527181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:33.535381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:33.536918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:33.538070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a23027d7-df57-4ede-aee1-97f97dd61577 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.161882 May 10 14:23:33.538678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 398/812] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:33 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:34.556144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:34.562972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:34.562972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:34.563317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:34.564085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:34.564522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:34.693230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:34.701321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:34.702844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:34.703989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a806b6f2-7b0a-4e8a-9769-9c9ac124db52 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152120 May 10 14:23:34.704779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 415/813] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:34 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:35.723175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:35.723796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:35.735312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:35.735773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:35.736560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:35.736997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:35.862019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:35.870880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:35.872388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:35.873553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01a367b5-bddb-453c-b962-715304839981 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154397 May 10 14:23:35.874102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 399/814] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:36.891633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:36.892258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:36.898220 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:36.898692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:36.899454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:36.899887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:37.034451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:37.043452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:37.044938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:37.046094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72735378-0353-44f6-bd73-319722e0b597 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.158633 May 10 14:23:37.046684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 416/815] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:38.064312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:38.065000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:38.071447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:38.071904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:38.072711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:38.073147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:38.206873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:38.216503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:38.218044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:38.219230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07799936-6f99-4bd7-8615-66f2dbd4fb9f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.159014 May 10 14:23:38.219907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 400/816] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:38 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:39.238218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:39.238850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:39.244709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:39.245769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:39.246606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:39.247041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:39.376607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:39.385070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:39.386761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:39.387907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31cd6440-069b-44bc-a295-329cd95b944e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153539 May 10 14:23:39.388454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 417/817] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:39 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:40.406907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:40.407623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:40.413926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:40.414408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:40.415168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:40.415599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:40.541650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:40.550224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:40.551708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:40.552844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a415fe01-b453-47bd-a7da-a4547569c14b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.149817 May 10 14:23:40.553400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 401/818] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:40 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:41.572336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:41.572876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:41.579849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:41.580286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:41.581047 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:41.581472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:41.708329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:41.717016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:41.718538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:41.719692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d494f5a-c6fb-4017-9dc9-6a798be24f2f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151334 May 10 14:23:41.720234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 418/819] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:41 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:42.738638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:42.739245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:42.746231 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:42.746680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:42.747555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:42.747987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:42.877310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:42.885508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:42.888381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:42.889537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f50e0b9-3295-4db6-b8e6-add4d3aab253 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154851 May 10 14:23:42.890095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 402/820] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:42 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:43.908497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:43.909140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:43.915263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:43.915698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:43.916476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:43.916911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:44.041559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:44.049977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:44.051510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:44.052661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-401ddf32-e26b-4684-9bcc-a6e764cb8786 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.147970 May 10 14:23:44.053211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 419/821] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:43 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:45.070979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:45.071602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:45.078433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:45.078878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:45.079635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:45.080064 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:45.212624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:45.221777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:45.223280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:45.224425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6acd5abe-8ae0-42c9-b73f-fefe282d19bf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.157355 May 10 14:23:45.224979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 403/822] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:45 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:46.243586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:46.244226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:46.250692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:46.251134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:46.251891 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:46.252315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:46.379470 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:46.387820 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:46.389327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:46.390476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14bd5e32-6458-4371-b168-fc691a73070a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150841 May 10 14:23:46.391024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 420/823] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:46 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:47.408706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:47.409295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:47.415181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:47.416506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:47.416506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:47.416825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:47.550576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:47.560326 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:47.561926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:47.563128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-716b4c13-edb0-40d0-b591-b7e93a961f04 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.158377 May 10 14:23:47.563682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 404/824] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:48.581567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:48.582187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:48.588323 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:48.588766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:48.589701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:48.590135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:48.738232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:48.747216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:48.748852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:48.750014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-728a6abb-8d91-41d6-b916-8760508f9bb5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.172355 May 10 14:23:48.750610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 421/825] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:48 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:23:49.543294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:49.543838 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:49.550137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:49.550702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:49.551505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:49.551943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:49.681928 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lazy-loading 'services' on Instance uuid f9825c2a-925f-439c-835d-00b5aade9041 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:23:49.769778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:49.770409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:49.776238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:49.776825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:49.777607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:49.778034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:49.906139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:49.914417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:49.915969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:49.917621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-300afc5b-8e75-4827-9777-e276561f5d18 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151195 May 10 14:23:49.918216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 422/826] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:23:49.929310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-35e76cbd-a0d3-4ef7-9197-a3d001f339ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments/5b4b0e96-1284-4ec9-b966-5ba20c5a1812" status: 202 len: 0 microversion: 2.1 time: 0.389725 May 10 14:23:49.930336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 405/827] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:23:49 2022] DELETE /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments/5b4b0e96-1284-4ec9-b966-5ba20c5a1812 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:23:50.937245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:50.937848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:50.943846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:50.944292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:50.945068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:50.945529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:51.077654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:51.085817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:51.087346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:51.088487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67eb73ad-e30e-470a-a14a-5aa96fa88af8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155746 May 10 14:23:51.089141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 423/828] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:50 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:52.107269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:52.107956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:52.114882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:52.115359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:52.116125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:52.116562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:52.251072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:52.251072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:52.252265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:52.253402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb6ee0d7-973f-4528-acba-62a7ebfcaec7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150557 May 10 14:23:52.253951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 406/829] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:52 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:53.272592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:53.273187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:53.279813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:53.280253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:53.281006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:53.281438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:53.412981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:53.421766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:53.423301 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:53.424455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1af9999-01dc-4caf-9b14-06434f7632e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155822 May 10 14:23:53.425002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 424/830] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:53 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:54.443035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:54.443647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:54.449949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:54.450449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:54.451213 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:54.451656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:54.739274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:54.748373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:54.749866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:54.751047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f8912be8-ad07-4452-9bfc-9680410abb01 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.311906 May 10 14:23:54.751625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 407/831] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:54 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:55.769028 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:55.769561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:55.775462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:55.775917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:55.776679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:55.777149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:55.900565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:55.908719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:55.910222 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:55.911381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd4e50a0-5830-4f23-9a6e-e1d7af59cc66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.146343 May 10 14:23:55.911932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 425/832] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:55 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:56.930433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:56.938171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:56.938347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:56.938696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:56.939457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:56.939893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:57.076533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:57.085079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:57.086596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:57.087755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0e94f23b-11fd-4600-8ece-7e1575aaf5fc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.161288 May 10 14:23:57.088286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 408/833] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:58.104867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:58.105477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:58.111474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:58.111918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:58.112686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:58.113121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:58.239025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:58.247339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:58.248842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:58.249984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-07991eaf-cbda-4d33-92ef-5e3246341ee1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.148939 May 10 14:23:58.250561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 426/834] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:23:59.268368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:23:59.268970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:23:59.275459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:59.275909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:59.276700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:23:59.277135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:23:59.406272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:59.414461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:59.415949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:23:59.417101 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-639a2607-afac-4a75-ae60-bae5c1663419 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152661 May 10 14:23:59.417638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 409/835] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:23:59 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:00.436208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:00.436782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:00.442694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:00.443145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:00.443912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:00.444347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:00.571113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:00.579620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:00.581194 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:00.582351 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6bdf52da-e57c-483e-931e-2dc301684756 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150392 May 10 14:24:00.582903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 427/836] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:00 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:01.601117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:01.601819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:01.609090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:01.609543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:01.610344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:01.610783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:01.751532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:01.759629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:01.761055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:01.763423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-11ab3486-70f9-43da-9345-b3296aede1d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.165749 May 10 14:24:01.763982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 410/837] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:02.781511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:02.782114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:02.788171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:02.788620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:02.789394 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:02.789826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:02.919691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:02.927999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:02.929494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:02.930699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee3229c2-4b7b-4855-9a97-c12a7ec7d306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153059 May 10 14:24:02.931239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 428/838] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:03.949185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:03.950461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:03.956821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:03.957268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:03.958025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:03.958493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:04.085617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:04.094968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:04.096474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:04.097654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-11f76245-2a7e-4a58-a0b2-04044d424cbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152328 May 10 14:24:04.098685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 411/839] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:03 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:05.116260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:05.116862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:05.123547 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:05.123988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:05.124754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:05.125187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:05.265875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:05.273991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:05.275533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:05.276666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ca35175-edd5-4af3-8e13-a48e12b09e70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.164276 May 10 14:24:05.277208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 429/840] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:06.295927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:06.296481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:06.305192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:06.305642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:06.306468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:06.306906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:06.433227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:06.441399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:06.442940 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:06.444110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0e459dd5-418a-438c-9203-463a3fce3315 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152450 May 10 14:24:06.444665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 412/841] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:06 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:07.463122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:07.463721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:07.470348 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:07.470806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:07.471565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:07.472000 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:07.602498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:07.611517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:07.613201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:07.614370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-397717a2-f4ad-40bc-8f58-388d8b76098c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155116 May 10 14:24:07.614917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 430/842] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:08.632877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:08.636349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:08.639955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:08.640762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:08.641536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:08.641979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:08.771434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:08.780037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:08.781516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:08.782790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93a89ba3-ed61-4e23-94b9-7e95ce872d79 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153866 May 10 14:24:08.783333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 413/843] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:08 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:09.801182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:09.801785 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:09.807692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:09.808402 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:09.809674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:09.810100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:09.939122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:09.947115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:09.948581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:09.950389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1d7facc-84f3-4b19-8ae0-1f02568191c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152414 May 10 14:24:09.950933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 431/844] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:09 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:10.969314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:10.969878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:10.976217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:10.976661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:10.977416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:10.977848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:11.106991 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:11.114810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:11.117702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:11.117702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d44028c6-bf21-4f7f-9fed-6fa68800faf9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152774 May 10 14:24:11.118004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 414/845] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:10 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:12.136840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:12.137581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:12.143433 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:12.143879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:12.144644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:12.145076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:12.277477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:12.287232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:12.288667 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:12.289813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2148550e-560b-4f49-964a-34bcda8f31f6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.156934 May 10 14:24:12.290370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 432/846] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:12 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:13.307753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:13.308629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:13.315733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:13.316188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:13.316962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:13.317399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:13.444499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:13.452880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:13.454416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:13.455573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2796cd26-7d28-41e4-bcaa-89e82b4452da tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151722 May 10 14:24:13.456117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 415/847] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:13 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:14.474012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:14.474569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:14.480421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:14.480969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:14.481733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:14.482310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:14.612567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:14.615609 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:14.617083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:14.618232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1dd257c6-62a4-4dd3-b23f-5f50b62ab6e5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.148094 May 10 14:24:14.618781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 433/848] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:15.638031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:15.638668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:15.645182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:15.645627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:15.646424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:15.646856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:15.776762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:15.785197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:15.786748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:15.787887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ced19d86-b8a7-4218-b50d-4791748335ab tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154700 May 10 14:24:15.788438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 416/849] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:15 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:16.806589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:16.807189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:16.813673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:16.814113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:16.814972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:16.815402 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:16.941635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:16.950972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:16.952511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:16.953745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-53a8f7db-169b-427b-a3b4-081407987857 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151030 May 10 14:24:16.954301 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 434/850] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:16 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:17.972809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:17.973350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:17.979377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:17.979832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:17.980598 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:17.981812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:18.109043 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:18.117234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:18.118773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:18.119951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c37bf0b-91f0-4925-9b32-00a268085a3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151356 May 10 14:24:18.120503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 417/851] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:17 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:19.138534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:19.139133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:19.145012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:19.145458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:19.146250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:19.146710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:19.282670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:19.290839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:19.292280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:19.293455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d95ef2b-e724-4f7b-8858-b0a5a260819d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.159401 May 10 14:24:19.294080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 435/852] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:19 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:20.312545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:20.313153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:20.319500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:20.319945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:20.320702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:20.321136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:20.447225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:20.456499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:20.458016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:20.459260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ab1233f-665e-4ab7-9539-c103face1036 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151603 May 10 14:24:20.459815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 418/853] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:20 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:21.477853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:21.478408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:21.484535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:21.484974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:21.485728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:21.486165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:21.616820 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:21.625707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:21.627230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:21.628382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0dc1ae5d-06a4-4e0d-b28a-c92853917fe0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154504 May 10 14:24:21.628922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 436/854] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:21 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:22.646642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:22.647243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:22.654246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:22.655096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:22.655869 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:22.656296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:22.797367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:22.805558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:22.807018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:22.808199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6b6f1c9-676c-4ac5-ab54-733e356c60c0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.165477 May 10 14:24:22.808752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 419/855] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:24:23.827551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:23.828262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:23.834067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:23.834554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:23.835317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:23.835748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:23.968080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:23.976210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:23.977698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:23.978868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44c94769-52dd-46c4-b8a3-a39153e1a23f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155893 May 10 14:24:23.979409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 437/856] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:23 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:24.996891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:24.997599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:25.003838 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:25.004292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:25.005060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:25.005499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:25.133652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:25.142439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:25.143929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:25.145074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f0f517cd-304d-4175-ab45-15cca0ca38a2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152168 May 10 14:24:25.145626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 420/857] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:24 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:26.164322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:26.164923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:26.171501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:26.171947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:26.172715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:26.173145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:26.301039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:26.309434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:26.310967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:26.312106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9a87d1f-fffa-45ce-a899-c4f1099e3fd6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151752 May 10 14:24:26.312649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 438/858] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:26 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:27.330622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:27.331267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:27.337442 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:27.337894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:27.338688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:27.339130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:27.472947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:27.481814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:27.483340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:27.489945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b5b49b89-33f0-4c82-a92e-491a7ed8f505 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.158014 May 10 14:24:27.489945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 421/859] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:27 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:28.510391 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:28.510988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:28.517259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:28.517704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:28.518489 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:28.518916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:28.647176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:28.656460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:28.657932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:28.659108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-332a02d3-97bd-4437-8c37-81d0d0a94761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152526 May 10 14:24:28.659652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 439/860] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:29.677949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:29.678573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:29.685485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:29.685936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:29.686730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:29.687161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:29.815350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:29.823420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:29.824906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:29.827128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-10383f2f-f609-443a-9ba7-6817cab66479 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153040 May 10 14:24:29.827677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 422/861] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:29 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:30.846144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:30.846695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:30.852625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:30.853065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:30.853818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:30.854276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:30.979833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:30.988615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:30.990087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:30.991322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d2ce6c7-8f9c-43bc-8680-8ed3e2a6b841 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.149394 May 10 14:24:30.991868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 440/862] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:30 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:32.009445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:32.010060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:32.016427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:32.016879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:32.017648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:32.018084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:32.145172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:32.153767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:32.155461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:32.156616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5ea6a5be-b82b-48a9-be8f-e37bfbc06530 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151254 May 10 14:24:32.157162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 423/863] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:33.174852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:33.175376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:33.181247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:33.181699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:33.182598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:33.182948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:33.323048 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:33.332488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:33.334098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:33.335562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bca8c674-87c1-4b33-839f-f9283d9a6c0c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.164647 May 10 14:24:33.337359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 441/864] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:33 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:34.354241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:34.354912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:34.361281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:34.361740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:34.362541 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:34.362984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:34.489300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:34.497506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:34.501390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:34.502586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-33d65f28-f844-40ad-b13d-e6c801b0cf71 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152391 May 10 14:24:34.503332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 424/865] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:34 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:35.521157 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:35.521750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:35.527588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:35.528028 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:35.528782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:35.529208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:35.660006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:35.668951 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:35.670494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:35.671607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2cc0eab0-47db-4630-a611-84cb19ba5bdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154742 May 10 14:24:35.672412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 442/866] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:36.689763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:36.690431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:36.696842 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:36.697234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:36.697989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:36.698453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:36.827447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:36.835614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:36.837109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:36.840089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c07f5b7d-fe04-4fe5-bca5-af7e696c91c4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153372 May 10 14:24:36.840089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 425/867] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:37.857346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:37.858572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:37.864571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:37.865018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:37.865811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:37.866272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:37.992269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:38.001128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:38.002863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:38.004955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa072091-4f84-482f-b494-1f02567f599b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151591 May 10 14:24:38.005536 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 443/868] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:37 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:39.023143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:39.023752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:39.029985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:39.030468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:39.031239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:39.031680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:39.158592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:39.166735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:39.168228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:39.169390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ec3b0b61-a950-47a4-a6a7-6f7052f69c1d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150245 May 10 14:24:39.169941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 426/869] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:39 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:40.188904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:40.189535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:40.195445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:40.195892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:40.196686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:40.197118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:40.325889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:40.334222 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:40.335722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:40.336866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f96819b4-bfc5-41a7-874e-e5b0a19a6f23 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153012 May 10 14:24:40.337415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 444/870] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:40 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:41.354877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:41.355418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:41.362022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:41.362502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:41.363265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:41.363697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:41.494189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:41.503452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:41.505244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:41.506504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c02e6446-5c9a-475d-9a15-3ffd1a35b127 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155519 May 10 14:24:41.507062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 427/871] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:41 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:42.524883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:42.525465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:42.531387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:42.531829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:42.532594 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:42.533023 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:42.659821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:42.668633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:42.670105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:42.671687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f13c926-4ba6-4657-849e-7816fd9d5ec1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150294 May 10 14:24:42.672237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 445/872] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:42 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:43.697047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:43.697851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:43.705452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:43.705904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:43.706725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:43.707156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:43.844507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:43.852621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:43.854143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:43.855364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4c08c1c-234b-4bc7-aba8-0ab39158cdbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.162286 May 10 14:24:43.855913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 428/873] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:43 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:44.872997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:44.873597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:44.879624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:44.880063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:44.880823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:44.881249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:45.005776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:45.013969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:45.015746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:45.016900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ca95fb2-aa09-4494-9318-aa7739556d9c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.147904 May 10 14:24:45.017454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 446/874] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:44 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:46.035200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:46.035814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:46.042079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:46.042561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:46.043327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:46.043765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:46.172871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:46.181402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:46.182951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:46.184104 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-19a31582-5521-4d0a-8569-88f981cd923d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153152 May 10 14:24:46.184659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 429/875] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:46 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:47.203007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:47.204188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:47.210169 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:47.210641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:47.211400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:47.211831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:47.339993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:47.348670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:47.350164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:47.351323 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9bc7bbba-7526-4b37-a4c8-4d6c04e433a0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152230 May 10 14:24:47.352029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 447/876] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:48.370109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:48.370725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:48.377036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:48.377494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:48.378301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:48.378743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:48.505207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:48.513373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:48.514907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:48.516065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-011f2799-a2f9-48f3-bf24-d2cdca2db24c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150018 May 10 14:24:48.517107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 430/877] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:48 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:49.536933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:49.537546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:49.543788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:49.544230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:49.545211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:49.545638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:49.707260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:49.718974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:49.721304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:49.722615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-508c9e31-3e61-4eaa-90cf-039be7121449 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.191109 May 10 14:24:49.723184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 448/878] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:50.741524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:50.742077 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:50.748416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:50.748866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:50.749631 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:50.750070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:50.877680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:50.885849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:50.887391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:50.888548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e0cd0bdd-1dff-4805-bc8c-9dcf75693182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151001 May 10 14:24:50.889103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 431/879] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:50 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:51.906791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:51.907433 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:51.913572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:51.914013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:51.914804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:51.915225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:52.041122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:52.050621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:52.052102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:52.053239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8abf198d-75a6-4b17-9c97-cec0b6a35f46 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150373 May 10 14:24:52.053775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 449/880] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:51 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:53.072648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:53.073257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:53.080498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:53.080951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:53.081729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:53.082178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:53.210596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:53.218788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:53.220914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:53.222113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60e607c1-31cf-44d1-b537-3948efbeade2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153454 May 10 14:24:53.222686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 432/881] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:53 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:54.240148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:54.240731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:54.246623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:54.247067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:54.247825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:54.248256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:54.376309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:54.385417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:54.386945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:54.388095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-443f67c8-d33d-4063-bff1-534fb6c6588a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151983 May 10 14:24:54.388642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 450/882] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:54 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:55.266086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:55.266639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:55.273057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:55.273511 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:55.274319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:55.274794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:55.300056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:24:55.406903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:55.407936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:55.414003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:55.414480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:55.415280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:55.415712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:55.545966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:55.557125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:55.558635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:55.561415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-734b1c8a-4b02-4f9f-a94a-c0ec62948235 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.158153 May 10 14:24:55.562521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 451/883] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:55 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:24:55.640902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bc4671ad-0709-4012-99a2-39a8f055f394 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "DELETE /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 204 len: 0 microversion: 2.1 time: 0.378724 May 10 14:24:55.641484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 433/884] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:24:55 2022] DELETE /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:24:55.649566 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:55.655947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:55.656215 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:55.656457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:55.657956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:55.658372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:55.793503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:55.801145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c1f64b07-6f06-477f-811d-1675ec42b308 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1579 microversion: 2.1 time: 0.155367 May 10 14:24:55.801695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 452/885] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:24:55 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:24:56.580716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:56.581338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:56.587630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:56.588077 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:56.588843 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:56.589278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:56.721041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:56.729415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:56.730962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:56.732114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c9177dcb-ab05-4be2-adc8-2d7d68d228ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155962 May 10 14:24:56.732662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 434/886] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:56.818814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:56.819418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:56.825670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:56.826119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:56.826915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:56.827358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:57.160699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:57.168086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa57411f-6a5f-4cc9-8354-aaef405d3386 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1579 microversion: 2.1 time: 0.353165 May 10 14:24:57.168561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 453/887] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:24:56 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1579 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:24:57.750760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:57.751901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:57.758171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:57.758658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:57.759428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:57.759863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:57.902845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:57.912728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:57.914451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:57.916007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c8dc6752-e1a9-4b28-beda-f4df09019915 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.168900 May 10 14:24:57.916650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 435/888] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:57 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:58.185594 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:58.186591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:58.193375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:58.193625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:58.194419 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:58.194848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:58.268197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:58.276605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-415daf96-a2a9-46e9-b1f8-2ec20158b3cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1511 microversion: 2.1 time: 0.094876 May 10 14:24:58.282344 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 454/889] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:24:58 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:24:58.512212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-4f9a9669-99ce-40dd-89c5-dff9b6ce0ff0 req-67d7ac8b-7c31-44fc-bc72-23db4f7d9b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340be81c-5d53-4810-9dff-18bcffaec607", "name": "network-vif-deleted", "tag": "6454f1f1-341d-4a6d-a2c2-1a201b99484e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:24:58.534046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4f9a9669-99ce-40dd-89c5-dff9b6ce0ff0 req-67d7ac8b-7c31-44fc-bc72-23db4f7d9b1c service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:58.534046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4f9a9669-99ce-40dd-89c5-dff9b6ce0ff0 req-67d7ac8b-7c31-44fc-bc72-23db4f7d9b1c service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:58.552919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-4f9a9669-99ce-40dd-89c5-dff9b6ce0ff0 req-67d7ac8b-7c31-44fc-bc72-23db4f7d9b1c service nova] Creating event network-vif-deleted:6454f1f1-341d-4a6d-a2c2-1a201b99484e for instance 340be81c-5d53-4810-9dff-18bcffaec607 on hv-cinder-84112 May 10 14:24:58.560212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-4f9a9669-99ce-40dd-89c5-dff9b6ce0ff0 req-67d7ac8b-7c31-44fc-bc72-23db4f7d9b1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051121 May 10 14:24:58.562129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 436/890] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:24:58.936927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:58.937562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:58.945220 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:58.945737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:58.946584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:58.947026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:59.078292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:59.087665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:59.089327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:59.090750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adfdeaa6-403c-43e2-b9bf-e20218d2edad tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.159168 May 10 14:24:59.091846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 455/891] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:24:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:24:59.354502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:24:59.355579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:24:59.362245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:59.362709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:59.363579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:24:59.363948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:24:59.431051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:24:59.439207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-42540b0f-76a0-46a4-b73a-b938e2c48b4c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.148502 May 10 14:24:59.439792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 437/892] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:24:59 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:00.109386 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:00.109920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:00.116548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:00.116996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:00.117763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:00.118221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:00.250253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:00.259907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:00.261410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:00.262643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-284953b6-e41a-47e5-baf1-224fddcd76b3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.157471 May 10 14:25:00.263218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 456/893] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:00 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:00.460251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:00.463106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:00.470139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:00.471413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:00.472204 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:00.472647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:00.536153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:00.543787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e105cd8b-9aa9-49d7-a5b2-fd9e5c91eb68 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088268 May 10 14:25:00.544351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 438/894] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:00 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:01.283065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:01.283699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:01.289478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:01.289930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:01.290741 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:01.291177 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:01.417046 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:01.426528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:01.428831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:01.429221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-122822e0-d5f7-482d-8a3a-fbc31b7d1139 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150661 May 10 14:25:01.429777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 457/895] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:01.560889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:01.561971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:01.568640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:01.569098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:01.569881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:01.570345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:01.634635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:01.642005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b98ed3ce-865c-49ec-aaa8-3a62cff4fefc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084995 May 10 14:25:01.642602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 439/896] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:01 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:02.448070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:02.448657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:02.455091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:02.455536 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:02.456347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:02.456742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:02.582408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:02.590507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:02.592029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:02.593170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4c36a976-1d86-405c-b211-261fc9f76f24 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.149057 May 10 14:25:02.593723 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 458/897] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:02.659801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:02.660424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:02.666996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:02.667448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:02.668219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:02.668656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:02.730001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:02.737671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-79dd3917-a32b-420a-a54b-da89e974deb0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082394 May 10 14:25:02.738260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 440/898] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:02 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:03.612791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:03.613389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:03.619579 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:03.620029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:03.620806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:03.621241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:03.750475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:03.754648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:03.755259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:03.759948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:03.761414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:03.761540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:03.761861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:03.762615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7aa9693c-084b-4c6e-a8c4-9f78780b8c90 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.154344 May 10 14:25:03.762738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:03.763076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:03.763180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 459/899] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:03 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:03.823947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:03.831314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a322ffee-bb63-4f72-9d96-2d61bd0367cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081060 May 10 14:25:03.831880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 441/900] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:03 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:04.780936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:04.781566 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:04.787542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:04.787990 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:04.788760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:04.789192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:04.847867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:04.848592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:04.856129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:04.856671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:04.857530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:04.857979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:04.936167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:04.944429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:04.944598 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55645d99-443c-496a-afab-3af84dd49830 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.100589 May 10 14:25:04.945081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 442/901] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:04 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:04.952836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:04.954315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:04.955743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96a1c660-1d52-447e-ab9e-3f3f7ae53391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.178746 May 10 14:25:04.956377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 460/902] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:04 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:05.961467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:05.962075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:05.968783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:05.968982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:05.969747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:05.970180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:05.974224 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:05.974757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:05.980554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:05.981006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:05.981763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:05.982187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:06.054684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:06.062186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ae7beed0-3136-4d3b-bf98-0e325d5ccabc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.104363 May 10 14:25:06.062770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 443/903] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:05 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:06.121738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:06.130948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:06.132441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:06.133592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-039be3c9-53f2-4dd3-904b-d64c67f5b919 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.163681 May 10 14:25:06.134155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 461/904] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:07.079413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:07.080182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:07.086621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:07.087068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:07.087830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:07.088272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:07.148248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:07.152250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:07.152849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:07.155588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a19e58b-5c84-4ed0-92bc-8fb0e7f6103d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080098 May 10 14:25:07.156149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 444/905] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:07 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:07.159717 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:07.160165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:07.160934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:07.161362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:07.291024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:07.304694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:07.306393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:07.307590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46c09070-1ce2-48c4-b1bb-ec5995f10fc3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.159090 May 10 14:25:07.308145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 462/906] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:08.172827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:08.173437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:08.180789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:08.181236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:08.181999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:08.182467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:08.244814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:08.252434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f57aa497-c8a5-4c16-9b18-53873ea93861 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083640 May 10 14:25:08.252998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 445/907] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:08 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:08.326111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:08.326765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:08.332780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:08.333228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:08.333991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:08.334453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:08.482380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:08.491615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:08.493085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:08.494231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73db8406-832f-43ec-a754-5180b70dbd31 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.172091 May 10 14:25:08.494777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 463/908] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:08 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:09.269591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:09.271075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:09.277329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:09.277782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:09.278581 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:09.279018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:09.343399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:09.350762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-140e0849-34f4-4942-ae21-f0de2cc49e71 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085024 May 10 14:25:09.351318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 446/909] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:09 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:09.512275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:09.512904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:09.518816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:09.519261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:09.521283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:09.521653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:09.648383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:09.656487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:09.657964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:09.659140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a213dc8-a3ca-40ff-96fd-f5c72c2bca10 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150789 May 10 14:25:09.659690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 464/910] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:09 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:10.367567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:10.368209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:10.374569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:10.375013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:10.375772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:10.376205 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:10.446120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:10.453509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-75d56673-13ca-4933-ad4a-3f2e155dbc67 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.090028 May 10 14:25:10.454057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 447/911] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:10 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:10.676754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:10.677359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:10.683339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:10.683794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:10.684569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:10.685003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:10.813369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:10.822156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:10.823669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:10.824808 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5fae0e5-b236-4d82-8f39-5f55d016e435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151954 May 10 14:25:10.825367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 465/912] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:10 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:11.470861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:11.471420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:11.478421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:11.478910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:11.479695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:11.480133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:11.542009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:11.549396 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-65708630-6f91-4282-b829-89790a1f5e37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082558 May 10 14:25:11.549959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 448/913] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:11 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:11.843444 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:11.844066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:11.851005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:11.851450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:11.852215 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:11.852650 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:11.979413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:11.987731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:11.989209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:11.990374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83eb49ca-9529-437e-be38-fdbec12cd19f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150773 May 10 14:25:11.990924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 466/914] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:11 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:12.567806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:12.569210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:12.575559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:12.576008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:12.576784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:12.577215 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:12.640015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:12.647423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f7218a15-eb75-48fc-b2f4-df6041090d95 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083671 May 10 14:25:12.647993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 449/915] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:12 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:13.009068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:13.009703 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:13.015634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:13.016088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:13.016860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:13.017295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:13.142363 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:13.150522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:13.152045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:13.153189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14ab3f69-6b65-493e-be3e-beec6d5a0a99 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.148260 May 10 14:25:13.153732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 467/916] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:13 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:13.663330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:13.663942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:13.670267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:13.670720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:13.671487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:13.671924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:13.735293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:13.742789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-36ce82eb-19d0-4eda-8910-d60966802451 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083412 May 10 14:25:13.743350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 450/917] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:13 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:14.172053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:14.172661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:14.180409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:14.180852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:14.181620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:14.182056 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:14.322496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:14.330526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:14.332003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:14.333126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37c3c8d6-7337-4ff9-a819-d125730aa4d8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.164948 May 10 14:25:14.333780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 468/918] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:14.759529 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:14.760138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:14.766729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:14.767180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:14.767941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:14.768373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:14.828619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:14.836597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4590b770-ec51-4531-9ae7-d043700de0ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081014 May 10 14:25:14.837157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 451/919] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:14 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:15.351495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:15.352091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:15.357980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:15.358449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:15.359209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:15.359635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:15.485039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:15.493886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:15.495414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:15.496567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-788807ef-01be-414a-b8c4-e9a9ba02b328 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.149483 May 10 14:25:15.497114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 469/920] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:15 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:15.852878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:15.853491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:15.859903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:15.860354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:15.861120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:15.861556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:15.924151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:15.932437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2d4bc2e5-7827-4ae0-9ba0-14c678193347 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084167 May 10 14:25:15.933003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 452/921] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:15 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:16.515302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:16.515918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:16.522279 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:16.522905 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:16.523647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:16.524083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:16.652476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:16.660714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:16.662490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:16.663640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3372afd1-2b27-404e-9e08-324278a9e37c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152291 May 10 14:25:16.664195 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 470/922] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:16 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:16.949411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:16.950029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:16.956114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:16.956567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:16.957342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:16.957785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:17.018679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:17.026167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3fb1861b-57a9-4bef-a553-2fd559192398 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080653 May 10 14:25:17.026779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 453/923] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:16 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:17.680845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:17.681488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:17.687392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:17.688090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:17.688851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:17.689273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:17.819296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:17.827453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:17.828934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:17.830058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6964a864-62fc-49e1-a1db-a75b126f9031 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153180 May 10 14:25:17.830640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 471/924] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:17 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:18.042916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:18.043488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:18.049759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:18.050227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:18.050992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:18.051425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:18.112569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:18.121015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cfe5cc40-5095-46ab-863f-b97ec345ba99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082075 May 10 14:25:18.121575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 454/925] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:18 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:18.849979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:18.850639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:18.856859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:18.857305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:18.858069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:18.858530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:18.983027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:18.991185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:18.992670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:18.993810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c8d9ab3-c5c8-43ed-a369-a8bcda9f8560 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.148374 May 10 14:25:18.994381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 472/926] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:18 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:19.137329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:19.137944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:19.144359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:19.144808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:19.145575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:19.146017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:19.210256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:19.217518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c45eb3ae-0680-4a13-a858-ac236e9b98c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084070 May 10 14:25:19.218084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 455/927] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:19 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:20.012102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:20.012675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:20.018643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:20.019095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:20.019859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:20.020291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:20.147495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:20.155690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:20.157191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:20.158372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40b901d4-02eb-4a3a-83d8-511ea33a6d93 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.150238 May 10 14:25:20.158917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 473/928] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:20 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:20.234453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:20.235071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:20.242139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:20.242616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:20.243385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:20.243950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:20.317857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:20.331317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b66ed203-2be3-4b1b-9744-b1fbd1e9a6ab tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.100724 May 10 14:25:20.331894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 456/929] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:20 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:21.176740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:21.177400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:21.183472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:21.183914 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:21.184680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:21.185108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:21.314965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:21.323745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:21.325225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:21.326408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-26b8b1eb-0b5c-4647-9221-7822d81e02b1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153492 May 10 14:25:21.326950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 474/930] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:21 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:21.350516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:21.351301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:21.357597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:21.358048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:21.358858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:21.359300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:21.422662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:21.435548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2c7f431b-ac98-478f-864d-0fe4ef2db029 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083960 May 10 14:25:21.435548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 457/931] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:21 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:22.347223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:22.348018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:22.355375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:22.355817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:22.356597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:22.357029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:22.449469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:22.450075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:22.456612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:22.457059 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:22.457858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:22.458322 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:22.493058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:22.502632 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:22.504357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:22.505813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37c25b66-cc99-43e5-8dce-55e8bf3a2097 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.163832 May 10 14:25:22.506385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 475/932] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:22.534503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:22.546416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b4f3d249-621d-4611-bad8-75339f4d1bf0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.100681 May 10 14:25:22.547136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 458/933] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:22 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:23.524760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:23.525346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:23.531357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:23.531800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:23.532562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:23.532987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:23.568551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:23.569234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:23.576377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:23.576824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:23.577689 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:23.578474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:23.662598 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:23.671270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-490dcfab-0e89-486e-ba87-c520f8b4a00f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.106747 May 10 14:25:23.672105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 459/934] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:23 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:23.707121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:23.711080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:23.712586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:23.713742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cba7d9ee-c3a1-41cb-a27b-b62355565c5d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.193150 May 10 14:25:23.714297 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 476/935] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:23 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:24.691173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:24.691783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:24.698862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:24.699313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:24.700078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:24.700515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:24.732532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:24.733133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:24.739042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:24.739487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:24.741328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:24.741771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:24.762800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:24.770092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8623d4bd-85f8-4caa-9b56-35b33778e706 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083177 May 10 14:25:24.770702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 460/936] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:24 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:24.871242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:24.881067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:24.882607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:24.883767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0270fce-9fe5-48a4-ba98-8580629e8124 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155063 May 10 14:25:24.884332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 477/937] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:24 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:25.787215 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:25.788080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:25.794620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:25.795432 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:25.795844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:25.796274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:25.867882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:25.875465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-960eae5e-3d4a-4c92-afe6-04aed009a68d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.092314 May 10 14:25:25.876032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 461/938] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:25 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:25.901859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:25.902491 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:25.908502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:25.909012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:25.909788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:25.910296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:26.057327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:26.067073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:26.069790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:26.070986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-648f85e7-ca9a-453a-a90c-537658a85226 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.173166 May 10 14:25:26.071533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 478/939] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:25 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:26.892976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:26.893621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:26.900227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:26.900674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:26.901449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:26.901884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:26.969865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:26.977765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-806fc7db-c09c-41b6-977b-d8d31a646d3a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088731 May 10 14:25:26.978382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 462/940] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:26 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:27.090049 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:27.090831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:27.097685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:27.098134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:27.098949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:27.099921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:27.239306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:27.248374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:27.249878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:27.251065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f557e4a6-3880-4afa-a4df-5982ff702181 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.165407 May 10 14:25:27.251610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 479/941] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:27 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:27.994848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:27.995384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:28.001703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:28.002153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:28.002962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:28.003400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:28.076315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:28.084658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3c549594-f765-4682-8690-6ac1b022b110 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.093032 May 10 14:25:28.085321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 463/942] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:27 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:28.269091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:28.269634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:28.276185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:28.276628 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:28.277392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:28.277818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:28.418219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:28.426381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:28.427922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:28.429040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-035466df-aa1e-40dd-8e9d-ca740fdedd82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.163962 May 10 14:25:28.429588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 480/943] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:29.101413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:29.101978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:29.108339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:29.108793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:29.109567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:29.110004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:29.171044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:29.178997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b7dc2751-d618-44d1-80e7-02c851608c05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081484 May 10 14:25:29.179555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 464/944] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:29 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:29.446701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:29.447305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:29.453168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:29.453609 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:29.454399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:29.454827 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:29.579168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:29.588134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:29.589761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:29.591031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4ebe5d2-e21a-4d6f-bb6e-d9628b3cc458 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.148201 May 10 14:25:29.591598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 481/945] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:29 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:30.196488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:30.197094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:30.203383 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:30.203826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:30.204583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:30.205012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:30.268234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:30.276315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d03fe602-643a-4349-af0f-5e71052f83a9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084711 May 10 14:25:30.276883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 465/946] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:30 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:30.613244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:30.613786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:30.620456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:30.620902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:30.621665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:30.622097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:30.750573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:30.759299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:30.760777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:30.761911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c8100724-4fe8-43ca-9e4f-1834700b6504 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152795 May 10 14:25:30.762503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 482/947] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:30 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:31.292992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:31.293514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:31.299830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:31.300281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:31.301056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:31.301496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:31.363441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:31.371472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2161422b-4115-4949-a79b-429210be273f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082422 May 10 14:25:31.372032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 466/948] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:31 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:31.780254 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:31.780927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:31.786911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:31.787859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:31.788629 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:31.789047 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:31.934275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:31.943032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:31.944751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:31.945884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45908edb-809f-49c1-ab91-c3b09279a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.169603 May 10 14:25:31.946454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 483/949] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:31 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:32.388285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:32.388891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:32.395368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:32.395822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:32.397241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:32.397684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:32.460762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:32.468445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d39f6501-b2fe-438b-b93b-b9266ca01caa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084019 May 10 14:25:32.469019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 467/950] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:32 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:32.964474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:32.965102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:32.971462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:32.971964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:32.972687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:32.973116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:33.116299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:33.124862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:33.126550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:33.127666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e8a7bdab-b16f-48e2-8fdf-ddf8be35b85a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.167483 May 10 14:25:33.128467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 484/951] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:33.485194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:33.485747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:33.493113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:33.493565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:33.494392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:33.494830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:33.562511 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:33.570473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5fda3c7c-0647-4136-9112-715f77fffe26 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.089386 May 10 14:25:33.571091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 468/952] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:33 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:34.145712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:34.146429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:34.153050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:34.153500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:34.154289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:34.154737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:34.292466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:34.300737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:34.302259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:34.304279 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5dd85248-3c52-4ad6-a1fc-b64539da5c53 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.162194 May 10 14:25:34.304842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 485/953] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:34 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:34.587296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:34.587940 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:34.594324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:34.594774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:34.595548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:34.595983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:34.658753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:34.667039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f980a04b-8dae-402b-ad16-18d5522d71cd tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083962 May 10 14:25:34.667614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 469/954] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:34 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:35.323077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:35.323710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:35.329508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:35.329959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:35.330754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:35.331192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:35.463929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:35.472363 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:35.473864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:35.475094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a1b333e-4270-4b96-854e-350ab43a6814 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155897 May 10 14:25:35.475649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 486/955] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:35.683285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:35.683939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:35.690618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:35.691070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:35.691844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:35.692283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:35.755701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:35.763970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71646103-4a18-40d6-aeef-01d65bcce019 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084539 May 10 14:25:35.764539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 470/956] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:35 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:36.494146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:36.494836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:36.500748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:36.501224 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:36.501982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:36.502448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:36.631383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:36.640014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:36.641509 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:36.642706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ffabaf3-b233-472a-bc14-ba9bfedb4015 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.153278 May 10 14:25:36.643260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 487/957] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:36.780495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:36.781145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:36.788051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:36.788430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:36.789213 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:36.789745 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:36.855447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:36.862756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a10c9f80-14e2-43be-8c60-63a53dbe93e7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086266 May 10 14:25:36.863308 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 471/958] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:36 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:37.661417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:37.662019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:37.668525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:37.668966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:37.669720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:37.670148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:37.796055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:37.804850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:37.806347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:37.807478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-53dfeb8b-38c3-4fd8-8cf6-ed2a8217316d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.149913 May 10 14:25:37.808031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 488/959] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:37 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:37.879483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:37.880117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:37.886518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:37.886971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:37.887735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:37.888172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:37.947987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:37.955255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-754bd0d2-1b30-42da-bacf-fc9a2e54d4a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.079752 May 10 14:25:37.955807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 472/960] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:37 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:38.825626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:38.826249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:38.832206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:38.832700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:38.833464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:38.833895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:38.962159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:38.970349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:38.971876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:38.972014 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:38.972517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:38.972972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f49e052-92af-432c-b998-24154afb593e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.151226 May 10 14:25:38.973516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 489/961] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:38 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:38.979130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:38.979585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:38.980357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:38.980801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:39.040784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:39.048049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f77211a-ef24-44d5-b15d-c4d71c108761 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.079906 May 10 14:25:39.048616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 473/962] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:38 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:39.991180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:39.991818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:40.001372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:40.001372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:40.001372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:40.001372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:40.119019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:40.119771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:40.126434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:40.126896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:40.127678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:40.127784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:40.128116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:40.136611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:40.138281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:40.139482 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb9d6bf4-50a2-4fda-9114-fb00dd7f8fbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.152337 May 10 14:25:40.140036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 490/963] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:39 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:40.193293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:40.201199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-08aeadc0-ce75-4e06-9b72-8b5bf6ace3f0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086296 May 10 14:25:40.201769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 474/964] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:40 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:41.159115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:41.159770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:41.166696 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:41.167195 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:41.167966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:41.168395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:41.218659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:41.219302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:41.226365 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:41.226818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:41.227600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:41.228048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:41.297650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:41.305161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6961fd2c-e927-44da-8428-ef26a98c63d9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.090359 May 10 14:25:41.305737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 475/965] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:41 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:41.320523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:41.328714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:41.330192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:41.331341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78d923b7-2e60-4d1e-9687-b7d988cfc43c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.176375 May 10 14:25:41.331879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 491/966] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:41 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:42.323086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:42.323693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:42.330247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:42.330740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:42.331519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:42.332013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:42.350311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:42.350932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:42.356733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:42.357181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:42.357937 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:42.358393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:42.398496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:42.405933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fc26e72c-6f3d-48c4-b690-d93b4467ea4d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.087337 May 10 14:25:42.406553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 476/967] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:42 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:42.494802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:42.502862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:42.504339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:42.505491 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-894fdcba-5552-4345-a277-4047cbe06b70 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.159173 May 10 14:25:42.506044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 492/968] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:42 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:43.425312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:43.426454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:43.434160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:43.434646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:43.435427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:43.435870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:43.498604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:43.509328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60ed7ccb-db07-4c37-aadb-7bef87e90a9b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.090368 May 10 14:25:43.509916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 477/969] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:43 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:43.524762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:43.525358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:43.531440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:43.531884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:43.532652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:43.533081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:43.669619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:43.678651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:43.680172 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:43.681335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e5729290-aa8a-4669-8714-73fd2e901c0f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.160993 May 10 14:25:43.681890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 493/970] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:43 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:44.526860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:44.527463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:44.535044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:44.535496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:44.536269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:44.536708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:44.602731 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:44.611131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7429f31d-662d-471e-919a-0af8455c53f2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088212 May 10 14:25:44.611703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 478/971] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:44 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:44.701142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:44.701772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:44.708719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:44.709354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:44.710739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:44.711182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:44.849183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:44.858137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:44.859653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:44.860816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8076e934-9273-4360-af6a-e0a81596901c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.163700 May 10 14:25:44.861350 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 494/972] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:44 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:45.627802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:45.628413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:45.635028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:45.635473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:45.636257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:45.636693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:45.699409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:45.710816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8d14807b-f3fb-4356-8fc6-f9f9726d5bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086706 May 10 14:25:45.711396 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 479/973] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:45 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:45.880683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:45.882069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:45.887897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:45.888342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:45.889142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:45.889551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:46.029134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:46.037723 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:46.039306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:46.040487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d844852-59b8-407e-abcf-a23a05953e84 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.163857 May 10 14:25:46.041151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 495/974] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:45 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:46.728231 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:46.904145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:46.904145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:46.904145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:46.904145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:46.905218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:46.905218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:46.905218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1efc9b54-f17c-404f-91b8-e9eb4e52b0c8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086811 May 10 14:25:46.905218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 480/975] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:46 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:47.059167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:47.059737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:47.066053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:47.066535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:47.067335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:47.067763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:47.199825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:47.208235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:47.210442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:47.211722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-043b03e0-09f6-48eb-89ea-c01b43fd8ec9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.156583 May 10 14:25:47.212281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 496/976] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:47.829399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:47.830026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:47.836549 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:47.837002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:47.837784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:47.838244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:47.902830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:47.910745 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-be078146-cf89-4df8-bcb5-255b8dfaf192 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085230 May 10 14:25:47.911321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 481/977] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:47 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:48.230896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:48.231491 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:48.237595 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:48.238036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:48.238826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:48.239254 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:48.374538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:48.383921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:48.385132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:48.386330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3585800c-980e-45f8-b462-edc060b12435 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.159323 May 10 14:25:48.386884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 497/978] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:48 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:48.928102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:48.928826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:48.935202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:48.935651 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:48.936454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:48.936890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:49.002906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:49.011246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fafa425b-ca6b-40b4-bcd7-c56372f9f1fa tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.087003 May 10 14:25:49.011833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 482/979] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:48 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:49.405094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:49.405728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:49.411690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:49.412612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:49.414462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:49.414952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:49.558631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:49.567482 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:49.569567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:49.571034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3cdcc014-9fed-4e20-8dec-72861f200cf6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.170103 May 10 14:25:49.571606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 498/980] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:50.029277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:50.029837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:50.036556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:50.037002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:50.038464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:50.038920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:50.103648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:50.111334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b718da44-c18b-4513-93ad-6c0443ad04d6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086015 May 10 14:25:50.111908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 483/981] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:50 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:50.589572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:50.590186 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:50.596290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:50.596738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:50.597511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:50.597948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:50.734589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:50.744656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:50.746142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:50.747329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db0afaa8-0fae-4a32-9bd0-64780558f4f2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.161711 May 10 14:25:50.747875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 499/982] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:50 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:51.128655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:51.129293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:51.136026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:51.136472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:51.138455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:51.138891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:51.211624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:51.219369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3b05512-e8b4-48c1-a2a1-612bb0235223 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.094768 May 10 14:25:51.219941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 484/983] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:51 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:51.766840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:51.767434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:51.774234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:51.774695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:51.775485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:51.775946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:51.932702 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:51.944779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:51.946677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:51.947890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aaf2e6e5-4037-4424-a49a-46a1ec02b37d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.185029 May 10 14:25:51.948435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 500/984] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:51 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:52.238968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:52.239860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:52.246770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:52.247229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:52.248018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:52.248462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:52.312242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:52.321025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-75eb22f0-d496-4c58-ad32-d89895f2d646 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085978 May 10 14:25:52.321600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 485/985] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:52 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:52.966303 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:52.966944 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:52.973408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:52.973756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:52.974601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:52.975573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:53.113906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:53.122920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:53.124409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:53.125570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-367bee9e-69bc-417a-afd2-d52fe4309391 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.163331 May 10 14:25:53.126126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 501/986] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:52 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:53.338655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:53.339305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:53.346133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:53.346622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:53.347428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:53.347873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:53.412124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:53.419769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f9d7fb39-3338-4ee1-8ee8-0853617fe559 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085713 May 10 14:25:53.420333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 486/987] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:53 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:54.144568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:54.145244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:54.151895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:54.152337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:54.153107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:54.153528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:54.283637 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:54.292916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:54.294421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:54.295571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8388882a-9396-415e-a4d1-6a0321203b6f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.155033 May 10 14:25:54.296128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 502/988] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:54 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:54.437121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:54.437686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:54.445270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:54.445752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:54.446560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:54.446997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:54.513608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:54.521679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c24c573c-d1e3-4d6b-a689-5646ca363f6a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088461 May 10 14:25:54.522357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 487/989] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:54 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:55.350148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:55.350148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:55.350148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:55.350148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:55.354332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:55.354332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:55.486772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:55.496424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:55.497929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:55.499118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42994023-d6fa-4667-9e13-ae14adb5f811 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.188837 May 10 14:25:55.499661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 503/990] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:55 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:55.543081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:55.543673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:55.550478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:55.550985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:55.553026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:55.553026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:55.618974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:55.626657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-91faa9d7-245b-4e8d-a099-2ab4cfa196ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088454 May 10 14:25:55.627249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 488/991] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:55 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:56.517328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:56.517994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:56.524514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:56.524951 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:56.525722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:56.526150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:56.644382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:56.645187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:56.652065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:56.652550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:56.653353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:56.653796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:56.676286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:56.686370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:56.687905 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:56.689061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-abbce527-ff48-4133-82ff-64011ba769e6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.175999 May 10 14:25:56.689628 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 504/992] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:56.729456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:56.737210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b408b807-c537-4048-955c-f34fcb9cfa9f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.096761 May 10 14:25:56.737791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 489/993] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:56 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:25:57.707724 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:57.708345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:57.714521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:57.714970 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:57.715746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:57.716179 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:57.753875 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:57.754492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:57.762070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:57.762547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:57.763336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:57.763782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:57.847607 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:57.856118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cf908c4b-3750-4d67-b4cc-1b4f2124672d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.106023 May 10 14:25:57.856717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 490/994] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:57 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:57.885805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:57.894540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:57.896023 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:57.897241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a611b4e-f93e-4661-ad89-d103873b797b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.193444 May 10 14:25:57.898232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 505/995] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:57 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:25:58.879965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:58.880581 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:58.887904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:58.888355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:58.889139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:58.889579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:58.919247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:58.919853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:58.928213 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:58.928687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:58.929627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:58.930058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:58.959259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:58.972499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b77e930a-15d0-4b64-b365-00764be3aad5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.096229 May 10 14:25:58.973002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 491/996] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:58 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:25:59.072758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:59.081760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:59.083153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:25:59.084323 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7507074-1b84-4c24-b150-dedb9334972f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.169072 May 10 14:25:59.085159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 506/997] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:25:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:25:59.989586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:25:59.990183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:25:59.997047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:59.997505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:25:59.998323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:25:59.998767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:00.062775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:00.071234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b7861179-ff58-4ec1-8fad-7ddf42e0369a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085645 May 10 14:26:00.071817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 492/998] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:25:59 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:00.102916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:00.104439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:00.109425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:00.109877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:00.110774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:00.111207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:00.242546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:00.250997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:00.252499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:00.253666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71be53d4-61a3-4b1d-a113-8ab67c08d126 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.155351 May 10 14:26:00.254454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 507/999] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:00 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:01.088671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:01.089229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:01.095460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:01.095916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:01.096677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:01.097108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:01.158124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:01.166015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce3e4225-2f7a-477b-b2ac-e11069b6fd7c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081985 May 10 14:26:01.166691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 493/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:01 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:01.272437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:01.273221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:01.279308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:01.279750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:01.280527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:01.280958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:01.413036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:01.421594 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:01.423139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:01.424305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d2595a7-b626-4444-81db-3093a2c84a47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.155831 May 10 14:26:01.424878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 508/1001] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:02.182900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:02.183497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:02.189925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:02.190422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:02.191468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:02.191905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:02.256226 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:02.264133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e3c1a42-baa1-420f-9046-884076dc548d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085088 May 10 14:26:02.264712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 494/1002] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:02 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:02.443839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:02.445415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:02.450967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:02.451413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:02.452215 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:02.452646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:02.586674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:02.595210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:02.596738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:02.597894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2ce7fb1-6586-431f-bbc2-d742fcddc844 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.158514 May 10 14:26:02.598482 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 509/1003] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:03.280929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:03.281850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:03.288607 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:03.289053 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:03.289836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:03.290298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:03.353462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:03.360938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-24e9a835-453b-4df6-83f3-b0bb7aa457b8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083919 May 10 14:26:03.361510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 495/1004] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:03 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:03.615981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:03.616538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:03.622687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:03.623137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:03.623913 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:03.624347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:03.758859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:03.767447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:03.768942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:03.770097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c6081854-b96f-420e-ad61-d5ad8f9e6bcb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.158139 May 10 14:26:03.770689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 510/1005] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:03 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:04.378645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:04.379253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:04.387095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:04.387544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:04.388325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:04.388783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:04.453993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:04.462310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7041f8dd-13a5-4f04-8876-b745430c9199 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.087726 May 10 14:26:04.462899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 496/1006] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:04 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:04.789326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:04.789929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:04.796051 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:04.796500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:04.797312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:04.797753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:04.938471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:04.947744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:04.949245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:04.950666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e7f7718-0588-4a71-a445-1546b7a0fa4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.165664 May 10 14:26:04.951276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 511/1007] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:04 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:05.479737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:05.480335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:05.486921 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:05.487380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:05.488208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:05.488642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:05.555480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:05.563079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-25682b60-449e-4e2a-963f-bfa49972428f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.087400 May 10 14:26:05.563605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 497/1008] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:05 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:05.973145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:05.973789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:05.983768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:05.984218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:05.985009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:05.985446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:06.337186 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:06.345792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:06.347324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:06.348504 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d2ce9ae-eebe-4b1f-af36-0fcd0f574a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.382733 May 10 14:26:06.349061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 512/1009] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:06.580528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:06.581076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:06.588032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:06.588509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:06.589340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:06.589773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:06.656355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:06.664569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1bc71b07-6258-451d-b7d3-f12d67da3fa6 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088010 May 10 14:26:06.665154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 498/1010] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:06 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:07.367941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:07.368556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:07.374643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:07.375081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:07.375837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:07.376261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:07.509268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:07.517856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:07.519477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:07.520660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-288823a4-3686-438e-89f2-457c13d05e48 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157386 May 10 14:26:07.521223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 513/1011] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:07.681638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:07.682298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:07.688717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:07.689166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:07.689935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:07.690400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:07.751519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:07.759861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-561430a7-5c2f-4ad2-92fe-a0785c06d7b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082864 May 10 14:26:07.760418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 499/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:07 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:08.538896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:08.539483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:08.545359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:08.545810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:08.546616 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:08.547050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:08.670687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:08.679024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:08.680260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:08.681408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9701f77-f71c-43f0-b0d5-6c9a0acdfb2c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.146578 May 10 14:26:08.681952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 514/1013] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:08 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:08.776777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:08.777402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:08.784195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:08.784641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:08.785417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:08.785850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:08.851465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:08.859145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ef8bf3f-a1b3-44de-8106-dabf39c7447f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086349 May 10 14:26:08.859715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 500/1014] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:08 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:09.700163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:09.700769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:09.707353 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:09.707823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:09.708640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:09.709076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:09.837449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:09.845905 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:09.847390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:09.848556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27d8cdbb-59ba-43f8-89ab-7cc79e31d650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152420 May 10 14:26:09.849095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 515/1015] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:09 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:26:09.876248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:09.876896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:09.883847 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:09.884302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:09.885073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:09.885515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:09.945953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:09.953284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8fb935d7-f924-44ca-a850-3e7df9bba7b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080889 May 10 14:26:09.954104 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 501/1016] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:09 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:10.867636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:10.868232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:10.874304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:10.874745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:10.875663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:10.876098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:10.971195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:10.972002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:10.978833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:10.979211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:10.980001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:10.980437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:11.008459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:11.016769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:11.018410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:11.019585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7db3e265-c9f4-40b4-a53d-084eeb14798f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.155906 May 10 14:26:11.020140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 516/1017] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:10 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:11.043999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:11.051311 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8edf9091-9d54-4eda-bdb6-a07ce61218ee tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084113 May 10 14:26:11.052089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 502/1018] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:10 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:26:12.039243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:12.039802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:12.045744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:12.046193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:12.046987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:12.047427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:12.069026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:12.069637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:12.076116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:12.076567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:12.077342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:12.077790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:12.152629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:12.160083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c1b3b4f7-8e93-42ed-8dbf-7af0a1158a90 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.095154 May 10 14:26:12.160649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 503/1019] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:12 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:26:12.201140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:12.209440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:12.211909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:12.213059 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f14cacd-9e8e-460d-aa19-6db4c17fcf95 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.178468 May 10 14:26:12.213602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 517/1020] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:12 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:13.176775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:13.177411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:13.184174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:13.184619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:13.185382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:13.185816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:13.232303 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:13.233054 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:13.239057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:13.239507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:13.240286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:13.240720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:13.248585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:13.255858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-44a61714-3d93-4b76-a94e-6962b198669e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082930 May 10 14:26:13.256428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 504/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:13 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:13.371433 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:13.379626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:13.381116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:13.382909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ae0e28e-9fbb-42d8-b7ff-d8edaf1da5e7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.155061 May 10 14:26:13.383451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 518/1022] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:13 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:26:14.274750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:14.275357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:14.281930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:14.282596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:14.283557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:14.283557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:14.344098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:14.352795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ff6c55d-4a8d-4a74-a9fd-069e8198f4bf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083107 May 10 14:26:14.353356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 505/1023] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:14 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:14.401497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:14.402123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:14.408013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:14.408455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:14.409212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:14.409634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:14.537883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:14.546950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:14.548475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:14.549611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80eba21b-090e-474f-925e-ed206aee6e47 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152631 May 10 14:26:14.550165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 519/1024] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:15.370108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:15.370717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:15.377481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:15.377929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:15.378716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:15.379149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:15.447370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:15.454641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-628bd9f6-17b3-4bf5-aac5-8eb664fa6b2e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.089082 May 10 14:26:15.455257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 506/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:15 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:15.568742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:15.570155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:15.576707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:15.577147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:15.577908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:15.578372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:15.706554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:15.715568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:15.717055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:15.718217 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61546183-5479-4dc0-976f-17512190a84e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153644 May 10 14:26:15.718767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 520/1026] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:15 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:16.472275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:16.472870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:16.480107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:16.480552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:16.481315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:16.481744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:16.557818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:16.557818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b687560d-3018-45a3-950f-40b9ed8c2844 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081927 May 10 14:26:16.557818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 507/1027] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:16 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:16.736551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:16.737338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:16.744317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:16.744953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:16.745730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:16.746161 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:16.878070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:16.887589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:16.889117 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:16.890272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d7db2d3-2512-455b-b586-3d638dd63497 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157630 May 10 14:26:16.890815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 521/1028] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:16 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:17.567998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:17.568694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:17.575890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:17.576360 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:17.577125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:17.577558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:17.641992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:17.649519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9e5b2fe3-63bd-48a5-b83d-48da981467f5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086070 May 10 14:26:17.650094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 508/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:17 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:17.908927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:17.909536 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:17.916165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:17.916616 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:17.917392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:17.917829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:18.047604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:18.055895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:18.057362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:18.058526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd2631b8-065d-4941-aef4-92c6589a33a4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153455 May 10 14:26:18.059084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 522/1030] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:17 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:18.666438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:18.667102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:18.673509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:18.673953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:18.674740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:18.675173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:18.739342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:18.747192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-61f8fc4a-c05b-4c8b-99b7-cf478bb8bd0a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085323 May 10 14:26:18.747754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 509/1031] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:18 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:19.075991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:19.076591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:19.082578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:19.083031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:19.083794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:19.084226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:19.216906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:19.225246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:19.227305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:19.228442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf45900e-3175-485f-9551-bd5f4339ca19 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156375 May 10 14:26:19.228992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 523/1032] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:19 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:26:19.764013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:19.764631 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:19.770930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:19.771382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:19.772138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:19.772720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:19.833144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:19.841303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7f862417-006f-4f89-853e-98dceff9e6fe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081157 May 10 14:26:19.841868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 510/1033] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:19 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:20.248234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:20.248828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:20.254760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:20.255203 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:20.255960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:20.256388 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:20.383792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:20.391909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:20.393393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:20.394562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-023eb5aa-a0a6-44ab-bc8f-01bad0f55770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.150661 May 10 14:26:20.395121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 524/1034] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:20 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:20.858322 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:20.858936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:20.865329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:20.865784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:20.866592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:20.867039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:20.928287 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:20.935598 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bdabfc5d-0bf4-4f52-977d-f20154e8fbfe tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081205 May 10 14:26:20.936168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 511/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:20 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:21.412684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:21.413333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:21.419360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:21.419772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:21.420523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:21.420947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:21.554787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:21.563510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:21.564983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:21.566160 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81f3a0da-5c31-483b-b761-f0dbe9143efa tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157306 May 10 14:26:21.566747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 525/1036] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:21 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:21.952671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:21.953276 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:21.959600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:21.960050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:21.961354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:21.961786 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:22.021879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:22.029316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0bafefc6-7b48-4d52-a865-1ebc34897a2b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080554 May 10 14:26:22.029875 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 512/1037] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:21 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:22.584877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:22.586128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:22.591971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:22.592422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:22.593190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:22.593621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:22.738065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:22.747025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:22.748513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:22.749663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ce68edaf-2f8a-49c4-a1ba-b38b05ebdb40 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.168715 May 10 14:26:22.750228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 526/1038] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:23.046778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:23.047384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:23.053647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:23.054419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:23.055278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:23.056234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:23.121420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:23.130548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e09421f-326e-4d81-b1ab-1cb89632b057 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.087590 May 10 14:26:23.131125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 513/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:23 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:23.768979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:23.769578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:23.776007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:23.776450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:23.777205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:23.777627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:23.902504 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:23.910675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:23.912170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:23.914073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f95d57d5-03f8-4fa3-b363-77bf4daa8650 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.148259 May 10 14:26:23.914797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 527/1040] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:23 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:24.147423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:24.148644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:24.155042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:24.155493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:24.156262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:24.156697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:24.217157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:24.224453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f6a8f6bf-7926-4d50-a2af-e7b22bfaa7d1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080897 May 10 14:26:24.225015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 514/1041] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:24 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:24.933066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:24.933682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:24.939894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:24.940331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:24.941091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:24.941518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:25.071666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:25.079995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:25.081480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:25.082646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9cf276f8-6ecb-4293-9f8d-cab961c6944f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.154343 May 10 14:26:25.083195 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 528/1042] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:24 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:25.240854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:25.241547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:25.248499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:25.248947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:25.249719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:25.250157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:25.310534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:25.318004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bd160481-3d6b-42e7-9ddb-87ee9b314519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080739 May 10 14:26:25.318600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 515/1043] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:25 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:26.103662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:26.104211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:26.110315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:26.110663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:26.111425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:26.111850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:26.244514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:26.252851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:26.254376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:26.255516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eccc0e7a-6e1e-408c-8990-b56805d39554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156376 May 10 14:26:26.256066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 529/1044] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:26 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:26.334456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:26.335071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:26.341575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:26.342033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:26.342839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:26.343281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:26.458735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:26.467238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f1480fd1-002d-49ce-8bcb-58df3fe7345e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.136699 May 10 14:26:26.467805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 516/1045] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:26 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:27.274078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:27.274713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:27.280831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:27.281277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:27.282044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:27.282510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:27.407961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:27.416963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:27.418495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:27.419640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8eb887fd-33d4-4ad5-90d1-51bae1819cdc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.149481 May 10 14:26:27.420189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 530/1046] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:27 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:27.484607 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:27.485242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:27.493045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:27.493499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:27.494343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:27.494789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:27.554901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:27.562268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5911841-af00-4b8d-b58c-969f91d50b97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081554 May 10 14:26:27.562833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 517/1047] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:27 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:28.438490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:28.439087 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:28.446222 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:28.446674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:28.447434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:28.447862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:28.579344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:28.579959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:28.586485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:28.586947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:28.587726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:28.588170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:28.635898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:28.644348 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:28.645856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:28.647050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2d585ec9-2a52-4f7f-a2b6-68a3f48b79d7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.212433 May 10 14:26:28.647686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 531/1048] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:28.651599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:28.660409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-199f68ff-9be6-4edb-9adf-b0b87feddaa3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084855 May 10 14:26:28.660981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 518/1049] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:28 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:29.667320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:29.667923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:29.673903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:29.674383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:29.675152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:29.675580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:29.676884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:29.677561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:29.684577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:29.685036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:29.685820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:29.686291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:29.767728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:29.775999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4adf6124-ae39-47fb-b994-f9c997db9ac8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.102967 May 10 14:26:29.776576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 519/1050] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:29 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:26:29.831417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:29.840605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:29.842089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:29.843238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47da4c64-9eb8-4ec9-803e-8b44ad97561a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.180445 May 10 14:26:29.843775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 532/1051] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:29 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:30.793908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:30.794883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:30.801874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:30.802366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:30.803154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:30.803627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:30.862319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:30.863095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:30.867277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:30.869388 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:30.870018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:30.870663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:30.871105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:30.874938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-847e45cc-11ed-4a49-bdb1-44fb5f46c0b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085067 May 10 14:26:30.875527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 520/1052] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:30 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:31.003828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:31.013111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:31.014614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:31.015762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f6b038b-eef5-4906-98a6-f3fef439d2ee tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157460 May 10 14:26:31.016304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 533/1053] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:30 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:26:31.892608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:31.893196 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:31.900139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:31.900586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:31.901526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:31.901962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:31.967625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:31.975123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-855b3eb5-707d-4fa5-8bff-c8778dae88b5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086323 May 10 14:26:31.975616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 521/1054] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:31 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:32.034791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:32.035392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:32.042726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:32.043168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:32.043932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:32.044356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:32.357685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:32.368788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:32.370562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:32.371998 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f290988-fcfb-4ccf-9abd-b8149059cf4e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.340967 May 10 14:26:32.372603 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 534/1055] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:32.992074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:32.993087 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:32.999393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:32.999836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:33.000593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:33.001061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:33.063680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:33.072385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c7f7ae5-a472-4929-b332-ff1f59812e97 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084728 May 10 14:26:33.072953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 522/1056] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:32 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:33.392732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:33.393326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:33.399406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:33.399854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:33.400654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:33.401084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:33.531252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:33.540448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:33.541941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:33.543118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5c2cedc-c1ba-4ea9-a8a0-29a63e386cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.154332 May 10 14:26:33.543660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 535/1057] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:33 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:34.089011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:34.089562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:34.095912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:34.096369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:34.097478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:34.097931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:34.161115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:34.168808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1278b41f-6b39-434d-a13f-c13feb791e29 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084447 May 10 14:26:34.169407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 523/1058] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:34 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:34.561399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:34.565068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:34.568826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:34.569361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:34.570381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:34.570821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:34.702508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:34.711700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:34.713132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:34.714345 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-636e6c30-12cd-439c-8f70-eda612e7820d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156895 May 10 14:26:34.714898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 536/1059] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:34 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:35.185399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:35.186002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:35.192292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:35.192745 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:35.193762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:35.194189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:35.258959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:35.266335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d347ab9d-a085-46c7-8893-4f15afd431c3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084771 May 10 14:26:35.267905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 524/1060] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:35 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:35.734212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:35.735379 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:35.742565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:35.743312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:35.744102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:35.744534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:35.879155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:35.887904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:35.889380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:35.890552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36609188-fa81-428f-aded-7b1bca27cd74 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.161158 May 10 14:26:35.891088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 537/1061] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:36.283294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:36.283918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:36.290876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:36.291327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:36.292092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:36.292527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:36.353617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:36.360998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f7df551d-e458-4d94-8320-a297d149b00b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081646 May 10 14:26:36.361570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 525/1062] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:36 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:36.908815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:36.909446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:36.916251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:36.916704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:36.917500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:36.917933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:37.052134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:37.061242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:37.062748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:37.063878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-afc93be3-516c-421f-8dbd-36755a169217 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.158942 May 10 14:26:37.064422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 538/1063] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:37.378044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:37.378814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:37.385293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:37.385734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:37.386538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:37.386970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:37.449737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:37.457557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-91ab33e3-5872-4e06-b419-ae9b62b3acbc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083425 May 10 14:26:37.458135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 526/1064] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:37 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:38.081964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:38.082574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:38.088649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:38.089093 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:38.089867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:38.095116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:38.292576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:38.301371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:38.302895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:38.304057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70dcf38f-e815-4733-8762-8b0d725812df tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.226263 May 10 14:26:38.305290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 539/1065] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:38 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:38.475176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:38.475786 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:38.483051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:38.483763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:38.484577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:38.485028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:38.551943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:38.560454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0aae2e11-3cf7-492b-b570-a127b82cc833 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.089101 May 10 14:26:38.561506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 527/1066] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:38 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:39.323279 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:39.323860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:39.330103 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:39.330574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:39.331340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:39.331775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:39.460735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:39.468897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:39.470599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:39.471923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45a4ef82-bd99-4a2e-8d18-85022bf9e2ff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153224 May 10 14:26:39.472467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 540/1067] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:39 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:39.578725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:39.579253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:39.586060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:39.586662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:39.587433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:39.587874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:39.649864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:39.659647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-58a94246-2e2c-419c-aa26-d005263b156f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084791 May 10 14:26:39.660219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 528/1068] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:39 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:40.490682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:40.491280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:40.497780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:40.498248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:40.499020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:40.499475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:40.632479 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:40.641342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:40.642937 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:40.644080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e84a875-f444-4a58-9681-6903fb5c7206 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157315 May 10 14:26:40.644624 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 541/1069] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:40 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:40.677518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:40.678133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:40.685261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:40.685723 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:40.686539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:40.686981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:40.752455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:40.760207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eccec11a-09a3-4135-8d20-bf275a94dbad tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086549 May 10 14:26:40.760776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 529/1070] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:40 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:41.662975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:41.663571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:41.670847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:41.671288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:41.672060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:41.672484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:41.777670 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:41.778305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:41.785086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:41.786004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:41.786424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:41.786863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:41.804505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:41.813229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:41.814798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:41.815974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-030dc81c-9b79-4c23-8cac-85ad287e7977 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156945 May 10 14:26:41.816730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 542/1071] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:41 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:41.856616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:41.864235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bfff0e54-246d-4d4a-9faa-c925b5b89b87 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.091765 May 10 14:26:41.864807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 530/1072] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:41 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:26:42.834790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:42.835401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:42.841541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:42.841979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:42.842769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:42.843198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:42.881156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:42.881854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:42.888829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:42.889278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:42.890056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:42.890516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:42.962323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:42.970979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b7dda414-024b-40d7-bb3e-70a50852057b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.093878 May 10 14:26:42.978911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 531/1073] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:42 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:26:43.000677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:43.009828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:43.011390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:43.012553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64bf583a-2497-4487-ab3e-fa99d9dc1b4a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.181692 May 10 14:26:43.013103 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 543/1074] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:42 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:43.988333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:43.988962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:43.995889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:43.996334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:43.997124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:43.997561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:44.030841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:44.031461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:44.037578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:44.038018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:44.038889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:44.039597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:44.072836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:44.080622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-443a300a-e80a-4151-a69e-3714eeee58b7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.096328 May 10 14:26:44.081414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 532/1075] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:43 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:44.172198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:44.181889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:44.183481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:44.184627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eef747fa-0b00-4262-8b90-ad3bca992022 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157706 May 10 14:26:44.185249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 544/1076] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:44 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:26:45.098326 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:45.098940 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:45.106087 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:45.106571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:45.107344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:45.107898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:45.168301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:45.175624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-41aeef5e-df2b-436d-b2ac-009e6869051d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081307 May 10 14:26:45.176179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 533/1077] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:45 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:45.203516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:45.204125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:45.210209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:45.211371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:45.212151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:45.212583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:45.338142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:45.346337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:45.347861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:45.349004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4919156d-e565-45b2-bc9a-6ca2a3fcf149 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.149438 May 10 14:26:45.349557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 545/1078] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:45 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:46.192381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:46.192998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:46.200253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:46.200704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:46.201482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:46.201924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:46.266980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:46.274621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b544a782-4df4-4fcd-a360-d96bd84ec726 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086137 May 10 14:26:46.275201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 534/1079] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:46 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:46.368192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:46.369164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:46.375446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:46.375888 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:46.376662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:46.377089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:46.516949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:46.525755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:46.527361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:46.528541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc6cf5d5-6d3c-4c28-8c8d-127c23c5579b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.165282 May 10 14:26:46.529164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 546/1080] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:46 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:47.291713 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:47.292260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:47.298515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:47.298972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:47.299763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:47.300205 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:47.364467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:47.373750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4aa60154-0b76-4584-a784-ace6275729ae tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086861 May 10 14:26:47.374370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 535/1081] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:47 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:47.546838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:47.547393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:47.553319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:47.553770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:47.554731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:47.555206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:47.694578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:47.708784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:47.711068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:47.713270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e432b437-8ccb-4c47-985b-fbb609edc44e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.169803 May 10 14:26:47.714828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 547/1082] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:48.393031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:48.393640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:48.400143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:48.400625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:48.401401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:48.401868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:48.462347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:48.469610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fd7f5247-9e18-44f1-aaf6-5acefb164d13 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080636 May 10 14:26:48.470351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 536/1083] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:48 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:48.738035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:48.738655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:48.744657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:48.745093 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:48.745882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:48.746343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:48.881340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:48.891662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:48.893206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:48.894459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c022179-7885-4a8e-9169-eeb1fd0619ae tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.160267 May 10 14:26:48.895063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 548/1084] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:48 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:49.487953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:49.488547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:49.495605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:49.496055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:49.496829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:49.497265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:49.562681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:49.570983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-daaeb4e1-8774-4c75-975c-cc3aec8f5e5a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086354 May 10 14:26:49.571545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 537/1085] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:49 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:49.913746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:49.914682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:49.920962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:49.921420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:49.922194 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:49.922649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:50.051268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:50.060479 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:50.061956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:50.063136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42d92968-2da6-4955-a0d6-eaf7bc0ef701 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153321 May 10 14:26:50.063865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 549/1086] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:50.588930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:50.589540 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:50.596002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:50.596455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:50.597227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:50.597664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:50.660159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:50.667801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d36612f9-a74f-44c5-92ef-2b2a03bf9328 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083612 May 10 14:26:50.668371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 538/1087] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:50 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:51.081897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:51.082537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:51.088560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:51.089010 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:51.089781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:51.090242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:51.219612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:51.229080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:51.230515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:51.231670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30146d59-c9d4-4136-9097-a6d383ac46f5 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153722 May 10 14:26:51.232223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 550/1088] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:51 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:51.684728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:51.685361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:51.691742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:51.692180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:51.692943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:51.693376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:51.759099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:51.766836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6fe8919e-f09f-44d0-9b53-bc889e54d253 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086043 May 10 14:26:51.767419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 539/1089] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:51 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:52.250390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:52.261452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:52.261452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:52.261452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:52.261452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:52.261873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:52.391644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:52.400577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:52.402183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:52.403368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2f2ed08-59b5-4162-8809-b132e7fe5404 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157021 May 10 14:26:52.403931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 551/1090] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:52 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:52.784997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:52.785609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:52.792119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:52.792570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:52.793355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:52.793792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:52.862192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:52.870250 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48b64be9-5f2a-4ae1-b742-2304d4ad1f99 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.089214 May 10 14:26:52.870830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 540/1091] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:52 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:53.428202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:53.428804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:53.435126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:53.435581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:53.436363 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:53.436800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:53.583138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:53.595156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:53.596859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:53.599457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e3cd0b9a-3447-4df3-b31f-af0dabc179d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.175272 May 10 14:26:53.600036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 552/1092] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:53 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:53.889076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:53.889866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:53.898623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:53.899081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:53.899873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:53.900313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:53.961948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:53.969534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e9c86d3b-a873-4584-8cd5-69aa6af9e632 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085674 May 10 14:26:53.970124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 541/1093] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:53 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:54.619267 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:54.619862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:54.625736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:54.626175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:54.627197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:54.627390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:54.760735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:54.768940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:54.770460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:54.771608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a30f3fe2-a4d0-4ad6-9ac9-bce6c84af770 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157552 May 10 14:26:54.772159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 553/1094] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:54 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:54.986424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:54.987037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:54.994074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:54.994546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:54.995319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:54.995757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:55.059441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:55.066886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bab1ace0-c99f-4f39-ba10-f3a8299538b2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084500 May 10 14:26:55.067441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 542/1095] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:54 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:55.790689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:55.791267 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:55.797138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:55.797576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:55.798353 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:55.798782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:55.924131 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:55.932286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:55.933762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:55.934928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d0ded71-c95f-4819-9e9c-1409bba73a76 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.148249 May 10 14:26:55.935489 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 554/1096] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:55 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:26:56.084290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:56.084876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:56.091666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:56.092110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:56.092870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:56.093298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:56.156988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:56.164980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9461a9a7-eec3-4b7d-9419-dc23b67402cc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084124 May 10 14:26:56.165544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 543/1097] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:56 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:26:56.953144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:56.953739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:56.959852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:56.960301 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:56.961106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:56.961721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:57.090402 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:57.099109 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:57.100604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:57.102533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe458ec0-c532-4179-ac7f-a71d8738665e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152483 May 10 14:26:57.103321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 555/1098] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:57.182061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:57.182694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:57.189022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:57.189472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:57.190260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:57.190701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:57.251227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:57.258687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-346ffc3f-7ac3-484b-ba46-98cb138d48d2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081244 May 10 14:26:57.259251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 544/1099] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:57 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:58.121004 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:58.121537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:58.127564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:58.128003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:58.128761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:58.129191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:58.259580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:58.267894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:58.269399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:58.270590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0cbf40a3-a6e0-4655-b73e-cd2342093df4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153564 May 10 14:26:58.271145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 556/1100] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:26:58.275636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:58.276444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:58.283120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:58.283597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:58.284399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:58.284835 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:58.345444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:58.353337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1534c674-ada4-47fd-9398-dc035d504d12 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082024 May 10 14:26:58.353903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 545/1101] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:58 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:26:59.186645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:59.187174 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:59.192955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.193415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.194189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.194659 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.266262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:59.266760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:59.272534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.272977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.274414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.274854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.300358 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:26:59.601453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eed72ad2-9319-45c2-9d00-c5e4186b1a5c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 204 len: 0 microversion: 2.1 time: 0.338612 May 10 14:26:59.602548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 546/1102] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:26:59 2022] DELETE /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:26:59.607928 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:59.608632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:59.615497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.615962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.616753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.617198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.755775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:59.764170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:59.765676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:59.766872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-98485e62-6673-426a-8b53-4dec9744ee11 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.163129 May 10 14:26:59.767450 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 547/1103] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:26:59 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:26:59.771893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:59.772504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:59.778981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.779429 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.780203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.780642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.850562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:26:59.858698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6976bedf-229d-4218-a322-4764519dfc37 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.090162 May 10 14:26:59.859210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 548/1104] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:59 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:26:59.863583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:26:59.864183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:26:59.869774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.870255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.871028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:26:59.871468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:26:59.996270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:00.003579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dba183ef-34df-4e6d-bd6b-a2999a410f1c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1682 microversion: 2.1 time: 0.143432 May 10 14:27:00.004144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 549/1105] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:26:59 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1682 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:00.787683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:00.788482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:00.795373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:00.795825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:00.796615 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:00.797055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:00.931802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:00.940240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:00.941726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:00.942922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-100a7818-1d0b-4fcb-8863-b5dcf6aafbb4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.160264 May 10 14:27:00.943482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 550/1106] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:00 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:27:00.954309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:00.954309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:00.956573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:00.957020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:00.957793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:00.958248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:01.025769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:01.033488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-16349e20-087d-434d-ba56-f9cab8b56011 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088968 May 10 14:27:01.034066 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 551/1107] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:00 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:01.047192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:01.047828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:01.053876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:01.054373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:01.055755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:01.056256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:01.188150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:01.197144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-64d55ab6-6b88-49fa-b3db-68a0e4daae17 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1682 microversion: 2.1 time: 0.153791 May 10 14:27:01.197728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 552/1108] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:01 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:01.921114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-9f4c3ee3-c875-45e2-ac71-dca80af5dd7f req-df292916-7cc2-400e-9ea2-caeb851a1ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be793a1-f88b-4fb2-8e17-41545f3a5ee3", "name": "network-vif-deleted", "tag": "583a709c-2a69-46cd-b56e-2731e7886ba1"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:27:01.930631 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9f4c3ee3-c875-45e2-ac71-dca80af5dd7f req-df292916-7cc2-400e-9ea2-caeb851a1ac9 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:01.930897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9f4c3ee3-c875-45e2-ac71-dca80af5dd7f req-df292916-7cc2-400e-9ea2-caeb851a1ac9 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:01.942054 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-9f4c3ee3-c875-45e2-ac71-dca80af5dd7f req-df292916-7cc2-400e-9ea2-caeb851a1ac9 service nova] Creating event network-vif-deleted:583a709c-2a69-46cd-b56e-2731e7886ba1 for instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 on hv-cinder-84112 May 10 14:27:01.947564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-9f4c3ee3-c875-45e2-ac71-dca80af5dd7f req-df292916-7cc2-400e-9ea2-caeb851a1ac9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029991 May 10 14:27:01.948787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 553/1109] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:27:01.963159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:01.963787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:01.970107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:01.970547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:01.971818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:01.971818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:02.125787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:02.135509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:02.137489 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:02.138784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f8716494-1473-4305-879a-4493e1e87fbf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.180298 May 10 14:27:02.139415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 554/1110] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:01 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:02.144286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:02.144960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:02.152091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:02.152628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:02.153529 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:02.154097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:02.221370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:02.229613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-383292bb-84c1-44b2-b122-04f7847d4d1c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088965 May 10 14:27:02.237543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 555/1111] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:02 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:02.237543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:02.237543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:02.244187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:02.244747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:02.245640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:02.246239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:02.282041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:02.282298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:02.282618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lazy-loading 'fault' on Instance uuid 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:27:02.326034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:02.335116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d21f0581-4c55-409f-928e-84477d142fe7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 200 len: 1331 microversion: 2.1 time: 0.103232 May 10 14:27:02.336587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 556/1112] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:02 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:03.157376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:03.158074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:03.165509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:03.165965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:03.166769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:03.167204 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:03.295169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:03.303252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:03.304735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:03.307102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71665027-de7b-4c88-a24f-f7311b3dec62 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153710 May 10 14:27:03.307660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 557/1113] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:03 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:03.312057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:03.312649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:03.318115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:03.318593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:03.319356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:03.319788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:03.380814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:03.388213 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2329f80d-3851-4326-968d-d68cb36aa6ef tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.079627 May 10 14:27:03.397349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 558/1114] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:03 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:03.397349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:03.397349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:03.399760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:03.400207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:03.400965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:03.401472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:03.415483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 HTTP/1.1 May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:27:03.417109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:27:03.418734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '2be793a1-f88b-4fb2-8e17-41545f3a5ee3'} May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:27:03.419657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:27:03.421216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:27:03.422577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:27:03.422577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0a4d9dd1-f1b8-426c-96a7-5f41dfd87f18 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 404 len: 111 microversion: 2.1 time: 0.028663 May 10 14:27:03.422577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 559/1115] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:03 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:27:03.426902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-302dcfd5-ab74-487e-885e-85432bbc530f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '.version_select at 0x7fef846b48b0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:03.509756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-302dcfd5-ab74-487e-885e-85432bbc530f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019273056" status: 202 len: 0 microversion: 2.1 time: 0.086259 May 10 14:27:03.510368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 560/1116] 10.222.0.58 () {58 vars in 1220 bytes} [Tue May 10 14:27:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019273056 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:27:04.325817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:04.326542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:04.333430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:04.333885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:04.334695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:04.335131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:04.460001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:04.469342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:04.470833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:04.472000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-25028c4d-bcb8-49cb-8eaa-dfe7babd0195 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.150585 May 10 14:27:04.472583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 561/1117] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:04 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:04.477595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3eb7f6ee-7387-45c7-8564-86df2ea583ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Action: 'create', calling method: .version_select at 0x7fef846b44c0>, body: {"keypair": {"name": "tempest-keypair-842305705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY4qtyZb/g5CbFa2XpvXOz8x9D2zRfgksftGOJyiVnYiyp3+IAOZx1cwT5NviRmoqPuDWEdFAqgwcE7MBegN4NaM1QNDzj7anMF2rMrNOdbS8cCzRso7QfrHK+nYq3ydg=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:27:04.491086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-3eb7f6ee-7387-45c7-8564-86df2ea583ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:27:04.495037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-3eb7f6ee-7387-45c7-8564-86df2ea583ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for user ecb4c97543e1452d8e6c8f1564addc76 and project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:27:04.594912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3eb7f6ee-7387-45c7-8564-86df2ea583ae tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121270 May 10 14:27:04.595539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 562/1118] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:27:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:27:04.600118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:04.600706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:04.607864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:04.608310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:04.609073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:04.609507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:04.672121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:04.679574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a8eca59-e20b-46c3-b0a1-6d697010b440 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083105 May 10 14:27:04.683935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 563/1119] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:04 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:05.491532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:05.492186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:05.499421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:05.499874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:05.500697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:05.501098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:05.632895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:05.641610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:05.643173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:05.644261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-322d0bf8-59df-41c9-8dd8-a330f0ca0e28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156806 May 10 14:27:05.644821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 564/1120] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:05 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:05.696777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:05.697419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:05.703535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:05.704262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:05.704806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:05.705242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:05.766091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:05.773409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93b14d2f-1e70-47a5-bbbc-f725c1154905 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080647 May 10 14:27:05.775088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 565/1121] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:05 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:06.663175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:06.663861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:06.670339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:06.670794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:06.671571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:06.672006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:06.857798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:06.866066 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:06.874574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:06.874574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ca3968aa-e226-4463-b9d8-c5b32f35afa7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.210630 May 10 14:27:06.874574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 566/1122] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:06 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:06.874905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:06.875278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:06.880937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:06.881319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:06.882075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:06.882528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:06.953004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:06.960405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0cb9b61e-3035-471f-863e-f69023efcebc tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.089053 May 10 14:27:06.960974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 567/1123] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:06 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:07.184743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1552088963", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e5ec3c3-4d17-4222-ba80-44b733b6bca6"}], "security_groups": [{"name": "tempest-securitygroup--1803700946"}], "key_name": "tempest-keypair-842305705", "user_data": "}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:27:07.284792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] validate_networks() for [('3e5ec3c3-4d17-4222-ba80-44b733b6bca6', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:27:07.702170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:27:07.702717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:27:07.703109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:27:07.703516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:27:07.703927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:27:07.714506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:07.714907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:07.715710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:07.716141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:07.732932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:27:07.736826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for user ecb4c97543e1452d8e6c8f1564addc76 and project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:27:07.748003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:27:07.750277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:27:07.871665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b22495a8-489b-4b76-9e7f-7f62e2dec7e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.690953 May 10 14:27:07.872398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 568/1124] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:27:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:27:07.882564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6675d7c3-d996-4ce6-93e3-8ce686b99d0b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:07.883918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6675d7c3-d996-4ce6-93e3-8ce686b99d0b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:07.936658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6675d7c3-d996-4ce6-93e3-8ce686b99d0b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:07.943394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6675d7c3-d996-4ce6-93e3-8ce686b99d0b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1241 microversion: 2.1 time: 0.064947 May 10 14:27:07.944059 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 569/1125] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:07 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:07.949523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:07.950223 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:07.956844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:07.957301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:07.958081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:07.958550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:08.094513 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:08.103597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:08.105189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:08.106444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-36bdd608-25c6-4722-9447-4fb24578df1b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.161397 May 10 14:27:08.107002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 570/1126] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:27:08.113792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:08.114419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:08.121420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:08.121868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:08.122658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:08.123086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:08.188919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:08.198887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd9c4574-fcda-4326-8a90-6ff7de6aa067 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088659 May 10 14:27:08.199538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 571/1127] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:08 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:08.960942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:08.962532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:08.968805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:08.969274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:08.970034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:08.970490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:09.032696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:09.040839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-759d1c4e-ba9a-45ed-b23e-a2e407e7a9e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1245 microversion: 2.1 time: 0.083860 May 10 14:27:09.041406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 572/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:08 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:09.124922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:09.125535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:09.131719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:09.132174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:09.132945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:09.134096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:09.266700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:09.277094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:09.277529 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:09.278767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e749a30c-b703-4ec7-bb7a-919f6642fa67 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157795 May 10 14:27:09.281878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 573/1129] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:09 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:09.283860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:09.284469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:09.290404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:09.290962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:09.291737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:09.292174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:09.355642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:09.363122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-282236c1-88b2-4f6f-88b1-2c1c44829d3b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082786 May 10 14:27:09.363686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 574/1130] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:09 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:10.058154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:10.059004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:10.065472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:10.066007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:10.066897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:10.067408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:10.130988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:10.139033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9cfcc445-a9bb-46c7-b635-ff16605755b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1311 microversion: 2.1 time: 0.085299 May 10 14:27:10.139601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 575/1131] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:10 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:10.297297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:10.297913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:10.303826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:10.305407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:10.305407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:10.305712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:10.437239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:10.445476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:10.448640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:10.448772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7185a6e5-a001-4002-8cb6-2828d270571e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.155595 May 10 14:27:10.449311 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 576/1132] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:10 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:10.453660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:10.454295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:10.460092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:10.460545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:10.461865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:10.462335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:10.523292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:10.531099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d9477d07-de85-4df5-b790-28ae02fb81d8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080713 May 10 14:27:10.533041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 577/1133] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:10 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:11.156188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:11.156897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:11.163253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:11.163743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:11.165024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:11.165450 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:11.299985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:11.308157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b3f63fd6-f930-4c78-9f51-5fbf4194ca0a tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.155807 May 10 14:27:11.308732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 578/1134] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:11 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:11.468218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:11.468982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:11.475501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:11.476081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:11.477910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:11.478621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:11.634424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:11.642843 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:11.644347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:11.645535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-af15479b-2bd4-48b7-a1c3-583d1e39d1af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.181464 May 10 14:27:11.646091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 579/1135] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:11 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:11.652246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:11.653039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:11.659449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:11.659902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:11.660679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:11.661111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:11.729722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:11.737576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b4b86496-b225-4e1a-a8b5-f3ebfda67ed3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.090287 May 10 14:27:11.738516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 580/1136] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:11 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:11.803320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-e93a623c-2f6e-42f0-be59-fde916cd840e req-33ce4c95-176f-4772-ae69-188907f67a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fb3f67-1347-46a8-aa95-3a656e9bc96f", "tag": "e478792c-03b1-4423-b9b6-8194a3bf41c8"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:27:11.811673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-e93a623c-2f6e-42f0-be59-fde916cd840e req-33ce4c95-176f-4772-ae69-188907f67a62 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:11.812121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-e93a623c-2f6e-42f0-be59-fde916cd840e req-33ce4c95-176f-4772-ae69-188907f67a62 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:11.824509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-e93a623c-2f6e-42f0-be59-fde916cd840e req-33ce4c95-176f-4772-ae69-188907f67a62 service nova] Creating event network-changed:e478792c-03b1-4423-b9b6-8194a3bf41c8 for instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f on hv-cinder-84112 May 10 14:27:11.830048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-e93a623c-2f6e-42f0-be59-fde916cd840e req-33ce4c95-176f-4772-ae69-188907f67a62 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090015 May 10 14:27:11.830644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 581/1137] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:27:12.327180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:12.327830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:12.333942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:12.334428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:12.335260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:12.335688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:12.463140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:12.472753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3f5aed94-b6ad-4cfb-99b9-72f754bccf71 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.150778 May 10 14:27:12.473324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 582/1138] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:12 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:12.663976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:12.664589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:12.670814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:12.671265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:12.672033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:12.672468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:12.798524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:12.807316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:12.808823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:12.809984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-39d16918-af30-4aad-9fae-914ed85d459f tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.149978 May 10 14:27:12.810571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 583/1139] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:12 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:12.815031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:12.815630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:12.823004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:12.823454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:12.824219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:12.824655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:12.890914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:12.898150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-86bb0e08-71bc-4e54-bd8f-ecfdb50a5692 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086657 May 10 14:27:12.898749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 584/1140] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:12 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:13.488871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:13.489545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:13.496924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:13.497422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:13.498232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:13.498665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:13.631905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:13.639733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-69013333-a603-4aea-9167-3f1d2e8b322c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.154668 May 10 14:27:13.640303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 585/1141] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:13 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:13.829509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:13.830045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:13.835971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:13.837039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:13.837978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:13.838425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:13.964034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:13.972286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:13.973796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:13.975000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-da6a6b54-b780-4d25-85a2-6de514794fdb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.149511 May 10 14:27:13.975558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 586/1142] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:13 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:13.980466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:13.981077 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:13.987076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:13.987524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:13.988284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:13.988715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:14.051752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:14.060107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd4b6b37-3251-4c14-8c15-316e3166f3ed tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083618 May 10 14:27:14.060684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 587/1143] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:13 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:14.656608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:14.657247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:14.663366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:14.663821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:14.664651 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:14.665095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:14.794410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:14.801966 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f0925ea8-c836-48e3-99e9-25742aca353f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.149232 May 10 14:27:14.802567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 588/1144] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:14 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:14.992487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:14.993167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:14.999147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:14.999599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:15.000366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:15.000801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:15.128401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:15.137710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:15.139252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:15.140424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b4b5a155-eaa5-4559-aea1-56afe728ae3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.151938 May 10 14:27:15.141007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 589/1145] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:14 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:15.145349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:15.145953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:15.152332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:15.152784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:15.153558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:15.154002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:15.217265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:15.224680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ebe0c8d9-8992-4281-8f96-51d8c667f01e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082732 May 10 14:27:15.225251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 590/1146] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:15 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:15.818354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:15.818990 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:15.826819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:15.827408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:15.828202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:15.828640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:15.959167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:15.966852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c95d3b94-1011-4d95-830e-ce79edca1cd1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.152510 May 10 14:27:15.967414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 591/1147] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:15 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:16.159536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:16.160185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:16.166131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:16.166614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:16.167387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:16.167831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:16.295035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:16.303519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:16.305027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:16.306447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4165f6c2-c3d8-4700-b7ec-f95fef1b2b08 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.150641 May 10 14:27:16.307085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 592/1148] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:16 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:16.311296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:16.311905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:16.317660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:16.318112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:16.318920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:16.319359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:16.385653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:16.393076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4b55f988-e0d4-4287-9598-934a82e18177 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085261 May 10 14:27:16.393647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 593/1149] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:16 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:16.984222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:16.984863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:16.990980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:16.991431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:16.992201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:16.992680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:17.119242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:17.126460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-edf04afc-546d-468d-b1b3-d1afea2d52b7 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.146230 May 10 14:27:17.127032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 594/1150] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:16 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:17.325481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:17.326003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:17.332022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:17.332475 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:17.333247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:17.333686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:17.459055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:17.467860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:17.469356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:17.470563 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4842f3f6-9577-4809-ae61-35508a5d24fe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.149722 May 10 14:27:17.471314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 595/1151] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:17 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:17.475687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:17.476287 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:17.482136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:17.482619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:17.483407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:17.483839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:17.549330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:17.557545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffbde3b4-3fa8-484d-ab22-d33cefb4ac86 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085258 May 10 14:27:17.558124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 596/1152] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:17 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:17.789273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-46572cf4-2a21-4903-a1f2-5b12075a63b9 req-6a9c4deb-1f7c-468f-9df2-286d5e2edecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fb3f67-1347-46a8-aa95-3a656e9bc96f", "name": "network-vif-plugged", "status": "completed", "tag": "e478792c-03b1-4423-b9b6-8194a3bf41c8"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:27:17.797913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-46572cf4-2a21-4903-a1f2-5b12075a63b9 req-6a9c4deb-1f7c-468f-9df2-286d5e2edecb service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:17.798531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-46572cf4-2a21-4903-a1f2-5b12075a63b9 req-6a9c4deb-1f7c-468f-9df2-286d5e2edecb service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:17.809629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-46572cf4-2a21-4903-a1f2-5b12075a63b9 req-6a9c4deb-1f7c-468f-9df2-286d5e2edecb service nova] Creating event network-vif-plugged:e478792c-03b1-4423-b9b6-8194a3bf41c8 for instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f on hv-cinder-84112 May 10 14:27:17.814709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-46572cf4-2a21-4903-a1f2-5b12075a63b9 req-6a9c4deb-1f7c-468f-9df2-286d5e2edecb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029479 May 10 14:27:17.815288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 597/1153] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:27:18.144426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:18.145095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:18.152683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:18.153137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:18.154032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:18.154503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:18.287578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:18.295003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-22839d39-3f84-44ac-8ade-a48150b6f4ab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.155431 May 10 14:27:18.295569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 598/1154] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:18 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:18.489644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:18.490449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:18.497301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:18.497756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:18.498559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:18.498996 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:18.638270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:18.646743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:18.648265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:18.649463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6e89f418-13f8-4ee2-9f04-391729cbfc3c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.164098 May 10 14:27:18.650023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 599/1155] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:18 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:18.654399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:18.655020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:18.660816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:18.661266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:18.662033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:18.662494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:18.726006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:18.733562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e1c03a36-9463-4a8f-a469-1d70efc86929 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082565 May 10 14:27:18.734130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 600/1156] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:18 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:19.311797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:19.312445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:19.318732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:19.319176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:19.319938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:19.320370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:19.448281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:19.455621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4b292f0-e440-4a4b-ac0d-47f00a876c37 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1367 microversion: 2.1 time: 0.147733 May 10 14:27:19.456190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 601/1157] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:19 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:19.667172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:19.667784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:19.673674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:19.674126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:19.674923 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:19.675363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:19.804708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:19.813176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:19.814736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:19.815857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc4ef2b1-73b8-46cd-8f77-769fd4c5029b tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152743 May 10 14:27:19.816422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 602/1158] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:19 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:19.820756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:19.826462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:19.828143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:19.828601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:19.829368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:19.829806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:19.893211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:19.901478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-11ecf317-efbf-4db2-b286-6d4ae5f3f6e5 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084095 May 10 14:27:19.902052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 603/1159] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:19 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:20.472987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:20.473672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:20.479950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:20.480401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:20.481168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:20.481606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:20.609950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:20.617597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-41b63613-7be4-4329-87bf-8f938485b2c4 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1558 microversion: 2.1 time: 0.148339 May 10 14:27:20.620280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 604/1160] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:20 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:27:20.634176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3a0335d1-5ee8-4b5c-b2ce-7afe64fb602f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:20.634812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3a0335d1-5ee8-4b5c-b2ce-7afe64fb602f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:20.640694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a0335d1-5ee8-4b5c-b2ce-7afe64fb602f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:20.641144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a0335d1-5ee8-4b5c-b2ce-7afe64fb602f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:20.641911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a0335d1-5ee8-4b5c-b2ce-7afe64fb602f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:20.642386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a0335d1-5ee8-4b5c-b2ce-7afe64fb602f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:20.719758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3a0335d1-5ee8-4b5c-b2ce-7afe64fb602f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089991 May 10 14:27:20.720371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 605/1161] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 10 14:27:20 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:27:20.834645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:20.835261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:20.841307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:20.841759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:20.842563 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:20.843019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:21.109714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:21.118792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:21.120334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:21.121484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eff12ede-2f28-469c-8a6d-49559ba8baeb tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.291045 May 10 14:27:21.122056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 606/1162] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:20 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:21.126498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:21.127159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:21.133065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:21.133568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:21.134394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:21.134829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:21.220419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:21.229182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5da38c8-4dd0-448a-948d-83caa0564bd0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.106087 May 10 14:27:21.229767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 607/1163] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:21 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:22.176036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-c58c1086-862d-4909-b8e4-e797b5b2132b req-f8c1df9e-a1bc-463a-b26b-b9ee27503408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fb3f67-1347-46a8-aa95-3a656e9bc96f", "tag": "e478792c-03b1-4423-b9b6-8194a3bf41c8"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:27:22.184383 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c58c1086-862d-4909-b8e4-e797b5b2132b req-f8c1df9e-a1bc-463a-b26b-b9ee27503408 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:22.184831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c58c1086-862d-4909-b8e4-e797b5b2132b req-f8c1df9e-a1bc-463a-b26b-b9ee27503408 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:22.197169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-c58c1086-862d-4909-b8e4-e797b5b2132b req-f8c1df9e-a1bc-463a-b26b-b9ee27503408 service nova] Creating event network-changed:e478792c-03b1-4423-b9b6-8194a3bf41c8 for instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f on hv-cinder-84112 May 10 14:27:22.202324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-c58c1086-862d-4909-b8e4-e797b5b2132b req-f8c1df9e-a1bc-463a-b26b-b9ee27503408 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080486 May 10 14:27:22.203188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 608/1164] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:27:22.209669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:22.210410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:22.217248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:22.217706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:22.218515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:22.218963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:22.359769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:22.370392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:22.371930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:22.373136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88e3a8c3-4012-4917-9a3a-6238c9c8afc0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.167695 May 10 14:27:22.384977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 609/1165] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:22 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:27:22.384977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:22.384977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:22.385898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:22.386296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:22.387092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:22.387536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:22.452378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:22.459883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1aeb02e1-dc3b-417b-be1b-bd1fb7f012a8 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085163 May 10 14:27:22.460817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 610/1166] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:22 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:23.392647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:23.393473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:23.400517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:23.400959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:23.401730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:23.402168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:23.527033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:23.536100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:23.537525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:23.538752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c2a75af2-412a-4387-b3b5-82fa0e4cb2d1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.150178 May 10 14:27:23.539316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 611/1167] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:23 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:23.544118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:23.544724 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:23.550952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:23.551410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:23.552189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:23.552632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:23.628208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:23.636555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88911d42-a7b0-43a5-b924-8521bf9783e0 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.096223 May 10 14:27:23.637133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 612/1168] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:23 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:24.559695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:24.560390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:24.566805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:24.567257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:24.568032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:24.568466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:24.705061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:24.714370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:24.715874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:24.717044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-23f8c8e5-2269-4eb4-89c8-eeb5be535b3a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.161587 May 10 14:27:24.717599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 613/1169] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:24 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:24.722769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:24.722891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:24.729347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:24.729800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:24.730594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:24.731029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:24.790691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:24.798300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f1c500e7-4a79-4455-a168-43333cc0c203 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.079745 May 10 14:27:24.798864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 614/1170] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:24 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:25.740252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:25.740919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:25.749249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:25.749919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:25.750979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:25.751582 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:25.880853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:25.888989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:25.890517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:25.891676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2651e641-8753-48f5-b5c0-9e48b9ea94f7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156768 May 10 14:27:25.892243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 615/1171] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:25 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:25.896671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:25.897276 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:25.903040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:25.903495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:25.904257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:25.904695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:25.969874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:25.977936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7396c888-d71b-472a-91f0-842a59df8a4e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084164 May 10 14:27:25.978473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 616/1172] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:25 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:26.910380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:26.911075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:26.917327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:26.917777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:26.918621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:26.919046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:27.047789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:27.056825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:27.058426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:27.059524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a0e19103-1cd9-4664-8b5a-83d5a376b51e tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153134 May 10 14:27:27.060083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 617/1173] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:26 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:27.064400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:27.065003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:27.070743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:27.071732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:27.072760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:27.073200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:27.134088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:27.141644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f65f9fab-d87b-49e7-ac19-b8dfac7e280b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080621 May 10 14:27:27.142233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 618/1174] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:27 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:28.077796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:28.078481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:28.084799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:28.085242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:28.085999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:28.086473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:28.225578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:28.234268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:28.235742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:28.236907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ada65eb7-d348-43b6-9d9a-55c478b7b762 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.163155 May 10 14:27:28.237465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 619/1175] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:28 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:28.241876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:28.242542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:28.249169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:28.249615 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:28.250424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:28.250858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:28.313459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:28.321841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7daff48b-529b-449b-a6b5-7d9ed20a5397 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082807 May 10 14:27:28.322899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 620/1176] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:28 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:29.255639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:29.256253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:29.263341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:29.263787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:29.264548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:29.264977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:29.396917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:29.406353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:29.407840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:29.409001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ba9cab5-eb60-4dbb-87df-e0e4e47fe2d2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157399 May 10 14:27:29.409559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 621/1177] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:29 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:29.414287 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:29.414929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:29.420612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:29.421058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:29.421818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:29.422278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:29.485835 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:29.493451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e85d4a74-5deb-4abf-89a7-6a9116ab1442 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082948 May 10 14:27:29.494012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 622/1178] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:29 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:30.427366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:30.428071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:30.435225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:30.435676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:30.436468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:30.436902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:30.564766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:30.573327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:30.574939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:30.576098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6dcabb25-3c02-473c-a559-cd54dcc32550 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152703 May 10 14:27:30.576650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 623/1179] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:30 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:30.580959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:30.581851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:30.588593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:30.589080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:30.589881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:30.590357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:30.651078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:30.658427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-22789d50-36d9-4523-9e05-0175137d7aa7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080803 May 10 14:27:30.659001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 624/1180] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:30 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:31.594492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:31.595260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:31.602265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:31.603670 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:31.604630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:31.605189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:31.740679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:31.749283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:31.751060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:31.752233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ca61986c-1f4e-4ae6-8f3c-63927754c41a tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.161789 May 10 14:27:31.752788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 625/1181] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:31 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:31.757140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:31.757738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:31.764906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:31.765357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:31.766186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:31.766617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:31.827686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:31.835170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5a157c9b-ce75-4eb9-911f-355b8921b1cf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081457 May 10 14:27:31.835725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 626/1182] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:31 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:32.772848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:32.773644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:32.780022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:32.780464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:32.781224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:32.781653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:32.909085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:32.917369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:32.918913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:32.920082 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-955ec259-e861-4fce-b3f7-58eff6ed3ab6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.151298 May 10 14:27:32.920642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 627/1183] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:32 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:32.924965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:32.925570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:32.931737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:32.932189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:32.932957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:32.933399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:32.997174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:33.004686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-58d45654-3241-49b6-b21f-3bd6f50cd519 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083110 May 10 14:27:33.005256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 628/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:32 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:33.938975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:33.939791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:33.946176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:33.946667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:33.947708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:33.948150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:34.085791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:34.094152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:34.095685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:34.096845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0bd6c7cf-c4d9-4abe-bee1-c1265e75c591 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.161836 May 10 14:27:34.097554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 629/1185] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:33 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:34.101874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:34.103031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:34.108863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:34.109311 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:34.110077 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:34.110554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:34.171626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:34.179331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f9fdb438-a36b-4c21-9d26-0a018167e752 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080797 May 10 14:27:34.179905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 630/1186] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:34 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:35.121378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:35.122048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:35.128389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:35.128841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:35.129610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:35.130051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:35.262210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:35.270442 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:35.271943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:35.273122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5f331626-fc49-490a-81a3-fc0bf11e51cc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156172 May 10 14:27:35.273688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 631/1187] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:35 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:35.278129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:35.278890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:35.284465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:35.284916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:35.285711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:35.286154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:35.349215 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:35.357141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e4560e40-5529-45fb-a34f-ea42b63e4b93 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082510 May 10 14:27:35.357880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 632/1188] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:35 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:36.292043 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:36.292797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:36.298920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:36.299366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:36.300129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:36.300558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:36.430006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:36.438617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:36.440123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:36.441297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-99e454c8-c4a4-471d-808a-880f3ff45f28 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.153462 May 10 14:27:36.441859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 633/1189] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:36 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:36.446902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:36.447895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:36.453694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:36.454152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:36.454963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:36.455399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:36.522356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:36.530080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f3e0851c-bba6-48b0-85b1-987f5cc9d17e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.087242 May 10 14:27:36.530684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 634/1190] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:36 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:37.460751 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:37.461411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:37.468619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:37.469065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:37.469834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:37.470298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:37.597536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:37.606381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:37.607892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:37.609060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-345896f0-85c5-4205-9368-1b1c8e4261b0 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152346 May 10 14:27:37.609624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 635/1191] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:37 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:37.614055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:37.614688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:37.620410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:37.620865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:37.621640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:37.622076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:37.686775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:37.694787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-088fa235-b8de-408e-8fa9-72983b74c7f7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.084223 May 10 14:27:37.695347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 636/1192] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:37 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:38.627447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:38.628128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:38.634954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:38.635403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:38.636166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:38.636599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:38.769290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:38.777498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:38.779027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:38.780181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ceb130b2-304a-46f2-94ef-8e2ad3743f43 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156616 May 10 14:27:38.780739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 637/1193] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:38 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:38.785103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:38.785701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:38.791216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:38.791666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:38.792437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:38.792870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:38.853441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:38.860755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e45ce57-27bd-4365-ae03-045b9efc9b42 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.079089 May 10 14:27:38.861320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 638/1194] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:38 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:39.798679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:39.799323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:39.805554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:39.806903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:39.807685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:39.808222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:39.944037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:39.953086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:39.954639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:39.955799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-39c68e20-6562-4f5a-b4cc-13a833343a49 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.161189 May 10 14:27:39.956366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 639/1195] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:39 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:39.960749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:39.961360 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:39.968262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:39.968707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:39.969500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:39.969933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:40.035652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:40.043657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9df40f09-2ff2-4db9-ab95-ef8bb71bbb78 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086349 May 10 14:27:40.044220 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 640/1196] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:39 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:40.975439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:40.976087 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:40.983561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:40.984013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:40.984785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:40.985255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:41.116072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:41.124765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:41.126325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:41.127486 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5f8e7668-70b7-45e7-801e-156ca0329bca tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156129 May 10 14:27:41.128036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 641/1197] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:40 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:41.132573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:41.133173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:41.139112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:41.147249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:41.147249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:41.147249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:41.201441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:41.208816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-870415c9-2780-4e2d-b3a3-157cbe16a151 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.079850 May 10 14:27:41.209379 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 642/1198] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:41 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:42.146426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:42.147091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:42.153916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:42.154413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:42.155188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:42.155624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:42.288119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:42.297277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:42.298802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:42.299973 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-30ddbea9-85c1-4bf1-a65e-cf6233e06905 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157569 May 10 14:27:42.300544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 643/1199] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:42 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:42.305014 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:42.305610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:42.313111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:42.313563 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:42.314396 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:42.314837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:42.382653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:42.390078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-00bcbbdd-2c2d-4170-8e78-7ad26302361b tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.088588 May 10 14:27:42.390677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 644/1200] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:42 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:43.318969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:43.319648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:43.326508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:43.326955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:43.327711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:43.328147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:43.461183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:43.470023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:43.472431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:43.473607 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c28ae0c-a220-449a-af7c-89cbe5295182 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.158593 May 10 14:27:43.474172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 645/1201] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:43 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:43.479458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:43.480065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:43.485687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:43.486139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:43.486942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:43.487381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:43.550634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:43.558991 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-480b7ed0-1bc5-480b-bc85-e7df40b7b62a tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083864 May 10 14:27:43.559557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 646/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:43 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:44.492783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:44.493646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:44.499946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:44.500397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:44.501170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:44.501606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:44.629449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:44.638400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:44.639911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:44.641075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-121b23b5-bc24-479b-a936-c36a689716cf tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152296 May 10 14:27:44.641638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 647/1203] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:44 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:44.646028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:44.646656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:44.652560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:44.653017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:44.653788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:44.654257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:44.716920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:44.724393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bbaa30a4-6b0c-4c86-b5ed-4a333eb53be3 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081793 May 10 14:27:44.724957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 648/1204] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:44 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:45.659372 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:45.660063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:45.667030 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:45.667479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:45.668269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:45.668707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:45.799056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:45.807382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:45.808880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:45.810046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-35aa99d9-393e-4b3d-99f0-c4409cb95761 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.154652 May 10 14:27:45.810639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 649/1205] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:45 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:45.814997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:45.815604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:45.821161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:45.821636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:45.822432 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:45.822877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:45.885827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:45.893486 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-19cd80d4-bf70-48d0-ae86-01ba7e44c06d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081910 May 10 14:27:45.894048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 650/1206] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:45 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:46.829086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:46.829947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:46.836076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:46.836524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:46.837856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:46.838321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:46.965562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:46.973802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:46.975257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:46.976488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ce999f6-fc07-4d0b-9aa3-fc90a6ff8e82 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.151545 May 10 14:27:46.977312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 651/1207] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:46 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:46.981710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:46.984143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:46.988125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:46.988571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:46.989328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:46.989758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:47.053774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:47.061946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-efa6067e-c39b-4940-8ec7-25e117a9ce5f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083956 May 10 14:27:47.062551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 652/1208] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:46 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:47.995629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:47.996253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:48.002517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:48.002968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:48.003734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:48.004174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:48.141416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:48.150190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:48.151771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:48.152955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-90e423c6-24fb-453f-bb87-b11fd2514059 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.161877 May 10 14:27:48.153519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 653/1209] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:47 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:48.157890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:48.158519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:48.164312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:48.164763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:48.166102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:48.166559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:48.226898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:48.234896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f69b055-3790-4961-a18b-3ace530797ec tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.080434 May 10 14:27:48.235459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 654/1210] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:48 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:49.171134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:49.171756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:49.178218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:49.178709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:49.179487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:49.179924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:49.311889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:49.320131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:49.322251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:49.323904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-27cbb0a4-3c3d-4da6-8786-e3d016bfcee4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.156481 May 10 14:27:49.324468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 655/1211] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:49 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:49.328802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:49.329405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:49.335453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:49.335899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:49.336660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:49.337095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:49.396611 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:49.404208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c8d44a6-afc6-4a3b-b26d-0de631d9adb2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.078805 May 10 14:27:49.404772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 656/1212] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:49 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:50.342618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:50.343278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:50.349891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:50.350373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:50.351130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:50.351562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:50.480494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:50.488868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:50.490406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:50.491576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ddfa5e7-e90f-463d-b1a6-8d0d44953fd9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.152889 May 10 14:27:50.492133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 657/1213] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:50 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:50.496485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:50.497080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:50.502491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:50.502946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:50.503716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:50.504149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:50.567763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:50.576168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4886128c-f359-4529-ba42-e2cf4d6dc321 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.083095 May 10 14:27:50.576738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 658/1214] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:50 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:51.509000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:51.509702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:51.516676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:51.517124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:51.517887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:51.518356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:51.644291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:51.653614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:51.655147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:51.656347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-473406e0-feb6-4341-8b5a-b2a9e2a28cce tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.151326 May 10 14:27:51.656942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 659/1215] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:51 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:51.661472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:51.662674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:51.668917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:51.669366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:51.670217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:51.670658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:51.732075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:51.739602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-30b9dc54-7583-44e4-8647-ea62d8fe8dd7 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.081701 May 10 14:27:51.740216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 660/1216] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:51 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:52.679595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:52.680324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:52.686539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:52.686984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:52.687752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:52.688187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:52.817894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:52.827010 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:52.828510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:52.829669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fde5c06d-3f25-46c8-b861-fb7aa0a0f9f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.154045 May 10 14:27:52.830249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 661/1217] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:52 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:52.834715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:52.835314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:52.841477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:52.841927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:52.842737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:52.843171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:52.903605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:52.911045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4a310f8d-0c18-4adf-a4d2-33923a5ecb0d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.079859 May 10 14:27:52.911604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 662/1218] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:52 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:53.848690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:53.849339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:53.856317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:53.856760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:53.857516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:53.857945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:53.990951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:53.999414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:54.000921 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:54.002083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5fc84d48-7047-487d-91cb-a567b4e24a7d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157342 May 10 14:27:54.002688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 663/1219] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:53 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:54.007086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:54.007687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:54.014300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:54.014757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:54.015592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:54.016029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:54.081593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:54.089476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e5a953fa-4d02-4f00-b929-5deb6ef13c98 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085850 May 10 14:27:54.090040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 664/1220] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:54 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:55.020616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:55.021227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:55.028580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:55.029016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:55.029805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:55.030270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:55.167727 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:55.175954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:55.177453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:55.178648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e5bdfc4-4223-4573-a092-8509b105a554 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.162146 May 10 14:27:55.179205 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 665/1221] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:55 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:55.183850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:55.184483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:55.190076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:55.190562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:55.191377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:55.191766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:55.258436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:55.267106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a309024a-edac-4566-812a-cf9019e608e2 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.086836 May 10 14:27:55.267614 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 666/1222] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:55 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:56.112461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:27:56.196729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:56.197917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:56.204557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:56.205004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:56.205776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:56.206226 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:56.339784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:56.347967 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:56.349496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:56.350677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-27b6f56c-db61-4fa3-8e2a-ecae00d63842 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.157800 May 10 14:27:56.351234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 667/1223] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:56 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:27:56.356410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:56.357004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:56.363242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:56.363763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:56.364463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:56.364896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:56.426328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:56.434586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3df729dc-60a9-47e9-a75a-0229b4ec246e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.082390 May 10 14:27:56.435156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 668/1224] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:56 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:57.196624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:57.197807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:57.204042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.204490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.205263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.205700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.231090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:27:57.550107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2c8ac0df-a2e5-43c3-8da7-f8e5cb650b42 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 204 len: 0 microversion: 2.1 time: 0.357181 May 10 14:27:57.550787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 669/1225] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:27:57 2022] DELETE /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:27:57.556720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:57.557496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:57.563485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.566562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.566562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.566562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.700466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:57.708974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:57.710497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:57.711656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01e85376-09ee-4233-83dd-7ea911b526b6 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.159655 May 10 14:27:57.712216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 670/1226] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:57 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:27:57.716955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:57.719020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:57.729533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.729988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.730866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.731305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.803859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:57.812005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c4818cea-a8d5-4a39-9e39-2478392321a1 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.098570 May 10 14:27:57.812579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 671/1227] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:57 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:57.816902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:57.817502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:57.824359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.824808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.825573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:57.826007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:57.954096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:57.961351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2e3e4938-2faf-4107-999c-788581f54694 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1689 microversion: 2.1 time: 0.147850 May 10 14:27:57.961906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 672/1228] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:57 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:58.732823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:58.733459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:58.739949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:58.740403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:58.741187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:58.741626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:58.887408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:58.895831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:58.897348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:58.898548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f43692f8-4fad-4611-bac1-155a70007f80 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.170869 May 10 14:27:58.899112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 673/1229] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:27:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:27:58.903683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:58.904288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:58.910753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:58.911202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:58.911987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:58.912423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:58.977279 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:58.985495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-301d6610-a558-4d70-b027-1de1ac09f647 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.085331 May 10 14:27:58.985980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 674/1230] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:58 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:58.990595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:58.991211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:58.997715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:58.998172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:58.998968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:58.999407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:59.132721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:27:59.140626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e5996028-2a1a-4b4a-8ab5-8d732405e33b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 200 len: 1689 microversion: 2.1 time: 0.153637 May 10 14:27:59.141217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 675/1231] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:27:58 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:27:59.246531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:27:59.246946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:27:59.253170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:59.263726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:27:59.263726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:27:59.263726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.570429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ddc9e97-104e-4b35-831c-b2c2baaddbf4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 202 len: 0 microversion: 2.1 time: 120.387161 May 10 14:28:59.571146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 557/1232] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:26:59 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 0 bytes in 120389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:28:59.584779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-b5377509-b39e-4ff7-ae5c-5e85f33067e9 req-5d3429b1-7fc3-4c88-b6b1-f4850add1983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0793014a-3668-44ee-81e2-19d304f47d99", "name": "network-vif-deleted", "tag": "54d433f1-3d6f-4e94-ab61-07a30d771d0c"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:28:59.593052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b5377509-b39e-4ff7-ae5c-5e85f33067e9 req-5d3429b1-7fc3-4c88-b6b1-f4850add1983 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:28:59.593486 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b5377509-b39e-4ff7-ae5c-5e85f33067e9 req-5d3429b1-7fc3-4c88-b6b1-f4850add1983 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.604409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-b5377509-b39e-4ff7-ae5c-5e85f33067e9 req-5d3429b1-7fc3-4c88-b6b1-f4850add1983 service nova] Creating event network-vif-deleted:54d433f1-3d6f-4e94-ab61-07a30d771d0c for instance 0793014a-3668-44ee-81e2-19d304f47d99 on hv-cinder-84112 May 10 14:28:59.610800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-b5377509-b39e-4ff7-ae5c-5e85f33067e9 req-5d3429b1-7fc3-4c88-b6b1-f4850add1983 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037981 May 10 14:28:59.611597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 558/1233] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:28:59.619031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:28:59.619031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:28:59.628897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:28:59.631113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.632520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:28:59.633270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:28:59.639367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.831809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:28:59.847963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:28:59.850640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:28:59.852618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e68b1128-af31-4cc1-9446-9c7e330d3dbe tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.239721 May 10 14:28:59.853539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 559/1234] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:28:59 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 1746 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:28:59.861093 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:28:59.865257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:28:59.870505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:28:59.871250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.871816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:28:59.872483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.951704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:28:59.960020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e151f09a-e100-41f7-a675-783a71903f2d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.105111 May 10 14:28:59.962781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 560/1235] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:28:59 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:28:59.965845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:28:59.966481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0793014a-3668-44ee-81e2-19d304f47d99] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:28:59.973550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:28:59.974049 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.974913 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:28:59.975343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:28:59.991517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] HTTP exception thrown: Instance 0793014a-3668-44ee-81e2-19d304f47d99 could not be found. May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Request method failure captured: May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 HTTP/1.1 May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPMqt8nEpdvfNrB-sXwTr0irXFMStdPkuBn7pYfF7tMdf2nAJuVnijPn12slEXDjzVetdWYlf5FTDKFih0lrzaS9pW3RmrkLU0SCgCwNdPyrBv7MnMrgMAyMwjiCP7S2ht8V5CY8FzEbQduLLW_GZCgk_G7dkMba2XOcYCe2sPSPf4 May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:28:59.993206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8a7f6dc00b5487b9c323783ef5aaa2b"}]}] May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 5e3edc87e7014d8598ba8c9517b81cf7 May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 0793014a-3668-44ee-81e2-19d304f47d99 could not be found. May 10 14:28:59.994869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '0793014a-3668-44ee-81e2-19d304f47d99'} May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0793014a-3668-44ee-81e2-19d304f47d99 could not be found. May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:28:59.995806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0793014a-3668-44ee-81e2-19d304f47d99 could not be found. May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0793014a-3668-44ee-81e2-19d304f47d99 could not be found. May 10 14:28:59.998456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:28:59.999746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Returning 404 to user: Instance 0793014a-3668-44ee-81e2-19d304f47d99 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:28:59.999746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-762d3f88-08fa-48aa-b774-a3d0852b2383 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99" status: 404 len: 111 microversion: 2.1 time: 0.033074 May 10 14:28:59.999746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 561/1236] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:28:59 2022] GET /compute/v2.1/servers/0793014a-3668-44ee-81e2-19d304f47d99 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:29:00.000720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-840590a6-cdab-490a-9272-53e3789638b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:29:00.001233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-840590a6-cdab-490a-9272-53e3789638b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:29:00.007663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840590a6-cdab-490a-9272-53e3789638b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:00.008111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840590a6-cdab-490a-9272-53e3789638b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:00.008897 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840590a6-cdab-490a-9272-53e3789638b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:00.009328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-840590a6-cdab-490a-9272-53e3789638b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:00.035473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-840590a6-cdab-490a-9272-53e3789638b1 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f/ips" status: 200 len: 149 microversion: 2.1 time: 0.039231 May 10 14:29:00.036052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 562/1237] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:28:59 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:29:00.041001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:29:00.041476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:29:00.048204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:00.048647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:00.049425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:00.049851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:56.289413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:29:56.292179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:29:56.293910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:29:56.294918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:29:56.296560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:29:56.298630 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:29:56.299961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) May 10 14:29:56.301552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:29:56.303068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-993d4b13-dbd0-4d0e-a092-f866e7593667) {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:29:56.303068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5682ef42-cba1-48ae-8011-94ad6e12ef9e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 117.051966 May 10 14:29:56.303068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 676/1238] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:27:59 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 117053 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 14:29:56.303068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffdcedc8-5300-4ef3-ae9a-dd282ca2764a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '.version_select at 0x7fef844d4700>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:29:56.411257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffdcedc8-5300-4ef3-ae9a-dd282ca2764a tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-675753142" status: 202 len: 0 microversion: 2.1 time: 0.115642 May 10 14:29:56.411841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 677/1239] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 10 14:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-675753142 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:29:56.421391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:29:56.421391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:29:56.426153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:56.426637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:56.427454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:56.427895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:56.502071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:29:56.510263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a693aec2-f763-4759-8567-6bc3a7190ebb tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.096161 May 10 14:29:56.510856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 678/1240] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:29:56 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:29:56.516022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-087b4913-901d-4a3b-914e-38f2ef70fad1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:29:56.516515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-087b4913-901d-4a3b-914e-38f2ef70fad1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:29:56.522540 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087b4913-901d-4a3b-914e-38f2ef70fad1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:56.523049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087b4913-901d-4a3b-914e-38f2ef70fad1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:56.523780 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087b4913-901d-4a3b-914e-38f2ef70fad1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:29:56.524219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087b4913-901d-4a3b-914e-38f2ef70fad1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:29:57.155586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:31:00.144380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:31:00.148330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:31:00.149972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:31:00.150677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:31:00.151816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:31:00.153507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:31:00.154850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) May 10 14:31:00.156457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:31:00.157788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7362c8df-9e86-4e77-a172-98fb960611dc) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:31:00.157788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-899159fb-d227-45c7-9720-05e3c7a401c2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 120.115297 May 10 14:31:00.157788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 563/1241] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:29:00 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 120119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:31:00.303697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:31:00.304319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:31:00.310450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:31:00.310900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:31:00.312237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:31:00.312673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:31:00.376432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:31:00.383841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b516562-fb35-46d9-8221-13fd5c20e05c tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.226614 May 10 14:31:00.384392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 564/1242] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:31:00 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:31:00.388972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:31:00.389452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:31:00.395749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:31:00.396196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:31:00.396997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:31:00.397442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:31:57.832846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:31:57.936672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-087b4913-901d-4a3b-914e-38f2ef70fad1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff" status: 202 len: 0 microversion: 2.20 time: 121.424514 May 10 14:31:57.937365 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 679/1243] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 10 14:29:56 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff => generated 0 bytes in 121426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:31:57.943001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:31:57.954086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:31:57.954086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:31:57.954086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:31:57.954086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:31:57.955050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:00.824738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:33:00.828647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:33:00.830949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:33:00.832521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:33:00.835383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.838816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:33:00.841330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) May 10 14:33:00.843666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:00.845390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47f008b3-09cd-4520-a324-d29b71e78872) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:33:00.845390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20f9644e-2777-4cfe-a477-4a569beda315 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 120.444798 May 10 14:33:00.845390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 565/1244] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:31:00 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 120447 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:33:00.845390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:33:00.845829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:33:00.850183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:00.850626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:00.851412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:00.852605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:00.884757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff HTTP/1.1 May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:33:00.887078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:33:00.888922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'server_id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9', 'id': '224d5959-b38b-4840-aaf0-0dd55d2a06ff'} May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224d5959-b38b-4840-aaf0-0dd55d2a06ff. May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:33:00.889820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:00.891126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:33:00.893416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:33:00.894504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e066aa85-2145-4cbc-beba-9079498f2e6c tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff" status: 404 len: 154 microversion: 2.20 time: 62.956093 May 10 14:33:00.895074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 680/1245] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 10 14:31:57 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff => generated 154 bytes in 62957 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:33:00.902651 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:33:00.903404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:33:00.909330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:00.909782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:00.911095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:00.911541 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:00.923886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:33:00.932791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6618f37-e5b6-4cbb-934f-f35766bf7c4f tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.099521 May 10 14:33:00.933766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 566/1246] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:33:00 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:33:01.062135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-897edc63-b850-418f-8226-f48c718f3667 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:33:01.063155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-897edc63-b850-418f-8226-f48c718f3667 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:33:01.069411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897edc63-b850-418f-8226-f48c718f3667 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:01.069859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897edc63-b850-418f-8226-f48c718f3667 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:01.070862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897edc63-b850-418f-8226-f48c718f3667 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:01.071804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897edc63-b850-418f-8226-f48c718f3667 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:01.113684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-897edc63-b850-418f-8226-f48c718f3667 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179109 May 10 14:33:01.114351 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 567/1247] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:33:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:33:01.119244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:33:01.119735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:33:01.125734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:01.126118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:01.126929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:01.127368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:58.023624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:33:58.058844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff HTTP/1.1 May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:33:58.061261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:33:58.063113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9', 'id': '224d5959-b38b-4840-aaf0-0dd55d2a06ff'} May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224d5959-b38b-4840-aaf0-0dd55d2a06ff. May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:33:58.065207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:33:58.066720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:33:58.068216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4b52d4f-37af-4bd8-b25e-0ae55d9969af tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff" status: 404 len: 154 microversion: 2.20 time: 56.947555 May 10 14:33:58.068216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 568/1248] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 10 14:33:01 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff => generated 154 bytes in 56948 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:33:58.069360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:33:58.070307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:33:58.075802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:58.076262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:58.077037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:58.077469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:58.143935 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:33:58.156556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c19c41a-798d-4376-bc91-faf784044a05 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1226 microversion: 2.1 time: 0.091444 May 10 14:33:58.158758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 569/1249] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:33:58 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:33:58.163819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:33:58.164317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:33:58.170401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:58.170856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:33:58.171697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:33:58.172136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.402119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:35:01.404335 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:01.405927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:01.407039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:01.408273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.409768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.410883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) May 10 14:35:01.412021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.413237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26fbde44-3938-46cb-a8d5-e0f2634c9b76) {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:01.413237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9faede26-161b-4e0e-9c0f-efe3ddad1a44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 120.509522 May 10 14:35:01.413237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 681/1250] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:33:00 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 120511 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:01.413237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3046775-4ce1-4b07-9746-0a5d7347535a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:01.415275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3046775-4ce1-4b07-9746-0a5d7347535a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:01.422163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3046775-4ce1-4b07-9746-0a5d7347535a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.422883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3046775-4ce1-4b07-9746-0a5d7347535a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.423699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3046775-4ce1-4b07-9746-0a5d7347535a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.424444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3046775-4ce1-4b07-9746-0a5d7347535a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.455282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:01.458960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3046775-4ce1-4b07-9746-0a5d7347535a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048145 May 10 14:35:01.458960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 682/1251] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:01.461944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:01.462659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:01.468829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.469238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.470131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.470502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.732796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:35:01.735866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:01.737606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:01.738537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:01.739728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.741118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.742376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) May 10 14:35:01.744376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:01.746168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-050f511c-0443-444e-8257-c1e4b5a1600a) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:01.746168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4c595f78-97c0-4db8-a151-fccd97c14e6e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 63.577566 May 10 14:35:01.746168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 570/1252] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:33:58 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 63579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:01.746168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:01.746889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:01.753002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.753453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.754275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.754716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.786278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff HTTP/1.1 May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:35:01.787888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:35:01.790235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'server_id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9', 'id': '224d5959-b38b-4840-aaf0-0dd55d2a06ff'} May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224d5959-b38b-4840-aaf0-0dd55d2a06ff. May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:01.792467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.793849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:01.795116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7fd52f5c-e429-4157-83e7-f512a76e7321 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff" status: 404 len: 154 microversion: 2.20 time: 0.331198 May 10 14:35:01.795116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 683/1253] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 10 14:35:01 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff => generated 154 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:01.795306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.795306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.795306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lazy-loading 'fault' on Instance uuid 340be81c-5d53-4810-9dff-18bcffaec607 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:01.795612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:01.795612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:01.802970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.803419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.804324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.804768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.841841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:01.850507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7989645d-ad33-4222-9730-9521b30acccf tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1231 microversion: 2.1 time: 0.110975 May 10 14:35:01.851099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 571/1254] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:35:01 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:35:01.855687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-df8bd79e-c27b-4a4a-b4d5-97f70d46bc02 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:01.856648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-df8bd79e-c27b-4a4a-b4d5-97f70d46bc02 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:01.863423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df8bd79e-c27b-4a4a-b4d5-97f70d46bc02 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.863869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df8bd79e-c27b-4a4a-b4d5-97f70d46bc02 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.864654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df8bd79e-c27b-4a4a-b4d5-97f70d46bc02 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.865254 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df8bd79e-c27b-4a4a-b4d5-97f70d46bc02 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.899932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:01.901235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-df8bd79e-c27b-4a4a-b4d5-97f70d46bc02 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049061 May 10 14:35:01.902171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 572/1255] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:01.907763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:01.908563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:01.915115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.915560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.916408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.916837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.960263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:35:01.962527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:01.963827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:01.964682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:01.965937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.967136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.968142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) May 10 14:35:01.971143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:01.972502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4691d87-432d-42b1-b77d-c2d923ea7dda) {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:01.972502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-30ceef14-df68-4d93-a3ef-0a2561926cce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 0.173124 May 10 14:35:01.972502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 684/1256] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:35:01 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:01.972502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:01.972856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:01.977926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.978412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:01.979190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:01.979623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.013401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.013857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.014344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lazy-loading 'fault' on Instance uuid 340be81c-5d53-4810-9dff-18bcffaec607 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:02.017111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff HTTP/1.1 May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:35:02.018862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:35:02.021044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9', 'id': '224d5959-b38b-4840-aaf0-0dd55d2a06ff'} May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224d5959-b38b-4840-aaf0-0dd55d2a06ff. May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:02.023406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.025722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:02.027037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b698e5d-6e92-4346-9910-bd46a245ba66 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff" status: 404 len: 154 microversion: 2.20 time: 0.117539 May 10 14:35:02.027037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 573/1257] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 10 14:35:01 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:02.027037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.027037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.033474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.033929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.034742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.035313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.064686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:02.073826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f1d14c8a-2d21-4763-93aa-ffd9a594b4ca tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1231 microversion: 2.1 time: 0.107001 May 10 14:35:02.074502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 685/1258] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:35:01 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:35:02.080327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-50428118-2ef6-450a-b77d-ead2c1829b4d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.081351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-50428118-2ef6-450a-b77d-ead2c1829b4d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.087652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50428118-2ef6-450a-b77d-ead2c1829b4d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.088103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50428118-2ef6-450a-b77d-ead2c1829b4d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.088904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50428118-2ef6-450a-b77d-ead2c1829b4d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.089346 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50428118-2ef6-450a-b77d-ead2c1829b4d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.120959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-50428118-2ef6-450a-b77d-ead2c1829b4d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045285 May 10 14:35:02.121546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:02.121946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 686/1259] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:02.127191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.127684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.134377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.135112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.136121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.136720 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.188996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:35:02.193932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:02.195674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:02.196300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:02.197314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.198565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.199793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) May 10 14:35:02.200879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.202079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c95673ae-ef5c-46d1-9b53-6cd02f49d496) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:02.202079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9aec4de-2d7e-4089-9c22-10e2f70f3ec8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 0.170795 May 10 14:35:02.202079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 574/1260] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:35:02 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:02.202079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.205125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.208569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.208569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.209286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.209852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.241038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff HTTP/1.1 May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:35:02.242595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:35:02.244354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'server_id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9', 'id': '224d5959-b38b-4840-aaf0-0dd55d2a06ff'} May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224d5959-b38b-4840-aaf0-0dd55d2a06ff. May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:02.245236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.246554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 is not attached to volume 224d5959-b38b-4840-aaf0-0dd55d2a06ff {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:02.247813 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bfe6523b-d8b9-4b22-8e34-a07dd3ad8565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff" status: 404 len: 154 microversion: 2.20 time: 0.121001 May 10 14:35:02.247813 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 687/1261] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 10 14:35:02 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments/224d5959-b38b-4840-aaf0-0dd55d2a06ff => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:02.249818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.250286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.250394 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.250743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lazy-loading 'fault' on Instance uuid 340be81c-5d53-4810-9dff-18bcffaec607 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:02.250947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.257330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.257780 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.258619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.259068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.297720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98be3f9cd80e4f62972dbf48591c7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674aa2ca44674c908e6393ef25d6719a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:02.306165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-175d44b6-9393-4dbd-87b1-23f9079bced9 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 200 len: 1231 microversion: 2.1 time: 0.111665 May 10 14:35:02.306939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 575/1262] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:35:02 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:35:02.312480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a5ac4ef-ce3b-467f-9493-0d156ade1087 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.314119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a5ac4ef-ce3b-467f-9493-0d156ade1087 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.326646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a5ac4ef-ce3b-467f-9493-0d156ade1087 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.329653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a5ac4ef-ce3b-467f-9493-0d156ade1087 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.329653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a5ac4ef-ce3b-467f-9493-0d156ade1087 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.329653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a5ac4ef-ce3b-467f-9493-0d156ade1087 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.349177 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lazy-loading 'services' on Instance uuid 9c342ab3-912f-4596-b007-862a7aa84479 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:02.389948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a5ac4ef-ce3b-467f-9493-0d156ade1087 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081323 May 10 14:35:02.391458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 576/1263] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:02.397155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c1c7d1f-986b-4172-a49f-c9532a099fbc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.398080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c1c7d1f-986b-4172-a49f-c9532a099fbc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.405271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c1c7d1f-986b-4172-a49f-c9532a099fbc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.405814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c1c7d1f-986b-4172-a49f-c9532a099fbc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.406735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c1c7d1f-986b-4172-a49f-c9532a099fbc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.407163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c1c7d1f-986b-4172-a49f-c9532a099fbc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.422904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Request method failure captured: May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 HTTP/1.1 May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienQTNn-V2spXq6wZhNTxFYz9BSGf4067oszv63qUGzKG_9DzxAFemfsAFpHWwngtCC9jDCBVM8noNoR6rxn_TZEeWl054zHWIiLYtvHXjieuIAV74VGuiPiQL4vOyc6pNClLH06v9xtqFgDJP5VLRH6cAL86IdzauY8F9lknTBBtYvc May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:35:02.425163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/709b9712f09a42a785d046e0c0f3846e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_709b9712f09a42a785d046e0c0f3846e"}]}] May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 709b9712f09a42a785d046e0c0f3846e May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1071485369 May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 48efa16cb9844fcd853f1e3760619a66 May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1071485369-project May 10 14:35:02.426499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '9c342ab3-912f-4596-b007-862a7aa84479', 'id': '9ef3adfb-6c35-4008-8656-86d4c5526fb7'} May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:02.427103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:35:02.428585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.429703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.430992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) May 10 14:35:02.433149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:35:02.434640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb05b210-1e87-43c5-91fb-cd4d0cf9b108) {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:02.434640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-59b8cd5e-73bd-42c3-9362-5b8888ea44fe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7" status: 400 len: 269 microversion: 2.1 time: 0.180970 May 10 14:35:02.434640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 688/1264] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:35:02 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479/os-volume_attachments/9ef3adfb-6c35-4008-8656-86d4c5526fb7 => generated 269 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:02.454374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c1c7d1f-986b-4172-a49f-c9532a099fbc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060551 May 10 14:35:02.454652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 577/1265] 10.222.0.58 () {60 vars in 1342 bytes} [Tue May 10 14:35:02 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:35:02.544313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.544914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.553917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.554409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.555207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.555706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.583200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:35:02.589793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.compute.api [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Working on deleting snapshot c23404be-161d-4d76-b0c6-daa82e338dcf from shelved instance... May 10 14:35:02.939300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.939839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.946346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.946555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.947380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.947884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.963236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] HTTP exception thrown: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Request method failure captured: May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 HTTP/1.1 May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienSI0pzM5sS2DPyVOTc3Vle4kMrs6T7M3HwQwWuiYDnlcSNdNkZnXJarKn5WO6c5Zv-ahQKDuL9viNhZba8YHGnUxOoZFrKooA_zS96N2U7qGOYp2dZQvBiBbUx2fQYbIJmP0ENtIFbyJOzNsMeColbBnTY79vPyrBzS-Vm_kcb89Os May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 674aa2ca44674c908e6393ef25d6719a May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-516031353 May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:35:02.964834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/674aa2ca44674c908e6393ef25d6719a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/674aa2ca44674c908e6393ef25d6719a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/674aa2ca44674c908e6393ef25d6719a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_674aa2ca44674c908e6393ef25d6719a"}]}] May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-516031353 May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 674aa2ca44674c908e6393ef25d6719a May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-516031353 May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-516031353-project May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 98be3f9cd80e4f62972dbf48591c7dd4 May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-516031353-project May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:02.967502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '340be81c-5d53-4810-9dff-18bcffaec607'} May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:02.969302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:02.970814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:02.972968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Returning 404 to user: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:02.972968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cb83815-2e50-4661-9a14-cda93716f021 tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "DELETE /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 404 len: 111 microversion: 2.1 time: 0.031167 May 10 14:35:02.972968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 578/1266] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:35:02 2022] DELETE /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:35:02.975525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:02.976135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] [instance: 340be81c-5d53-4810-9dff-18bcffaec607] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:02.982066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.982483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.983262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:02.983738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:02.997195 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] HTTP exception thrown: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Request method failure captured: May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 HTTP/1.1 May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienSI0pzM5sS2DPyVOTc3Vle4kMrs6T7M3HwQwWuiYDnlcSNdNkZnXJarKn5WO6c5Zv-ahQKDuL9viNhZba8YHGnUxOoZFrKooA_zS96N2U7qGOYp2dZQvBiBbUx2fQYbIJmP0ENtIFbyJOzNsMeColbBnTY79vPyrBzS-Vm_kcb89Os May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 674aa2ca44674c908e6393ef25d6719a May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-516031353 May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:35:02.998754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/674aa2ca44674c908e6393ef25d6719a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/674aa2ca44674c908e6393ef25d6719a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/674aa2ca44674c908e6393ef25d6719a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_674aa2ca44674c908e6393ef25d6719a"}]}] May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-516031353 May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 674aa2ca44674c908e6393ef25d6719a May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-516031353 May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-516031353-project May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 98be3f9cd80e4f62972dbf48591c7dd4 May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-516031353-project May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:03.000336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '340be81c-5d53-4810-9dff-18bcffaec607'} May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:03.001231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. May 10 14:35:03.002657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:03.003918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Returning 404 to user: Instance 340be81c-5d53-4810-9dff-18bcffaec607 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:03.003918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bfd25c25-7d39-4789-90dd-495f97e06d7e tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607" status: 404 len: 111 microversion: 2.1 time: 0.028678 May 10 14:35:03.003918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 579/1267] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:35:02 2022] GET /compute/v2.1/servers/340be81c-5d53-4810-9dff-18bcffaec607 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:35:03.403108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8943209a-f9da-4427-ac6a-1f9dacc9376c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:03.404095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8943209a-f9da-4427-ac6a-1f9dacc9376c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:03.410362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8943209a-f9da-4427-ac6a-1f9dacc9376c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:03.410805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8943209a-f9da-4427-ac6a-1f9dacc9376c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:03.411572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8943209a-f9da-4427-ac6a-1f9dacc9376c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:03.411997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8943209a-f9da-4427-ac6a-1f9dacc9376c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:03.445060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8943209a-f9da-4427-ac6a-1f9dacc9376c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045923 May 10 14:35:03.445689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 580/1268] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:04.455605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Doing local delete in cell 164fd8b6-494f-4056-845b-5dc9e7551c56(cell1) {{(pid=117661) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 10 14:35:04.456472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:04.456923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c76dbc5-d442-4877-ab3c-80b4343fe4b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:04.457301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:04.457397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.compute.api [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 10 14:35:04.457860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c76dbc5-d442-4877-ab3c-80b4343fe4b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:04.461171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] deallocate_for_instance() {{(pid=117661) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 10 14:35:04.464993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c76dbc5-d442-4877-ab3c-80b4343fe4b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:04.464993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c76dbc5-d442-4877-ab3c-80b4343fe4b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:04.465203 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c76dbc5-d442-4877-ab3c-80b4343fe4b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:04.465465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c76dbc5-d442-4877-ab3c-80b4343fe4b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:04.495161 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c76dbc5-d442-4877-ab3c-80b4343fe4b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 May 10 14:35:04.495735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 581/1269] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:05.509959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c70fdd76-7af1-41b7-b585-ad502b073c97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:05.510927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c70fdd76-7af1-41b7-b585-ad502b073c97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:05.517572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70fdd76-7af1-41b7-b585-ad502b073c97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:05.517939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70fdd76-7af1-41b7-b585-ad502b073c97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:05.518763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70fdd76-7af1-41b7-b585-ad502b073c97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:05.519196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70fdd76-7af1-41b7-b585-ad502b073c97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:05.553081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c70fdd76-7af1-41b7-b585-ad502b073c97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049740 May 10 14:35:05.553577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 582/1270] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:05.965821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Updating instance_info_cache with network_info: [] {{(pid=117661) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 14:35:05.968456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-57f8d3a1-97ea-4215-aa1f-080dee53009c req-16eeda2b-ed9d-4b90-8500-db447244c734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a50ebb-7db2-481e-a381-14f2aa6f3ec9", "name": "network-vif-deleted", "tag": "b322516a-ad64-4f70-89e2-1b69a91a3ade"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:35:05.976877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-57f8d3a1-97ea-4215-aa1f-080dee53009c req-16eeda2b-ed9d-4b90-8500-db447244c734 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:05.977399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-57f8d3a1-97ea-4215-aa1f-080dee53009c req-16eeda2b-ed9d-4b90-8500-db447244c734 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:05.990155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.compute.server_external_events [req-57f8d3a1-97ea-4215-aa1f-080dee53009c req-16eeda2b-ed9d-4b90-8500-db447244c734 service nova] Unable to find a host for instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9. Dropping event network-vif-deleted {{(pid=117660) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 14:35:05.991077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-57f8d3a1-97ea-4215-aa1f-080dee53009c req-16eeda2b-ed9d-4b90-8500-db447244c734 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.120303 May 10 14:35:05.991674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 583/1271] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 121 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 10 14:35:06.566281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67f3ea8d-7fd7-4950-88f7-d7b0c3da444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:06.567207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67f3ea8d-7fd7-4950-88f7-d7b0c3da444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:06.574234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.scheduler.client.report [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Deleted allocations for instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 May 10 14:35:06.575768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f3ea8d-7fd7-4950-88f7-d7b0c3da444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:06.576217 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f3ea8d-7fd7-4950-88f7-d7b0c3da444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:06.578962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f3ea8d-7fd7-4950-88f7-d7b0c3da444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:06.579481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f3ea8d-7fd7-4950-88f7-d7b0c3da444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:06.612151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67f3ea8d-7fd7-4950-88f7-d7b0c3da444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051376 May 10 14:35:06.612721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 584/1272] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:07.080038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ab93de62-861e-46b1-917c-30faab878aff tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 204 len: 0 microversion: 2.20 time: 4.539647 May 10 14:35:07.080650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 689/1273] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 10 14:35:02 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 0 bytes in 4541 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:35:07.090622 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:07.091511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:07.098162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:07.098647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:07.099425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:07.099866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:07.115233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 HTTP/1.1 May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:35:07.116985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:35:07.118605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9'} May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:35:07.120066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:35:07.121541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:35:07.123961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:35:07.123961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c84050a-ed72-4439-99f1-8503ca6429ea tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 404 len: 111 microversion: 2.20 time: 0.033130 May 10 14:35:07.123961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 585/1274] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:07 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:35:07.134324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8038e92f-504c-4631-9c1a-946e4df6a565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '.version_select at 0x7fef84774c10>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:07.213438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8038e92f-504c-4631-9c1a-946e4df6a565 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706248831" status: 204 len: 0 microversion: 2.20 time: 0.087313 May 10 14:35:07.214021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 690/1275] 10.222.0.58 () {60 vars in 1261 bytes} [Tue May 10 14:35:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706248831 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:35:07.624274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-583324e7-3545-487c-a25e-2bb55f35ea4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:07.625228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-583324e7-3545-487c-a25e-2bb55f35ea4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:07.631672 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-583324e7-3545-487c-a25e-2bb55f35ea4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:07.632114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-583324e7-3545-487c-a25e-2bb55f35ea4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:07.632883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-583324e7-3545-487c-a25e-2bb55f35ea4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:07.633309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-583324e7-3545-487c-a25e-2bb55f35ea4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:07.668487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-583324e7-3545-487c-a25e-2bb55f35ea4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048582 May 10 14:35:07.669062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 586/1276] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:08.186003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a48a7de2-5f67-435f-a322-ddaf24920452 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Action: 'create', calling method: .version_select at 0x7fef89622e50>, body: {"keypair": {"name": "tempest-keypair-332434994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYx5+Zgqq9ZRGeFtn2W07iOYuQfF3bDYmyuMDAje+OQ1hdMwQ2sIS2REZtSdrJ/Ble3unUHB/eDC7S7L4pD6CGnM0SHYQJKxiZoU8x425KxwiYnkTmkRMVC2azjk92Nzg=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:35:08.202261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a48a7de2-5f67-435f-a322-ddaf24920452 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:35:08.206304 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a48a7de2-5f67-435f-a322-ddaf24920452 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for user 9dae4d7a57f343c8bb7b92dbebea181d and project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:35:08.304799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a48a7de2-5f67-435f-a322-ddaf24920452 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.123102 May 10 14:35:08.305406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 691/1277] 10.222.0.58 () {62 vars in 1199 bytes} [Tue May 10 14:35:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 14:35:08.681812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0f15415-a381-4625-9050-afd3f42a3581 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:08.682799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0f15415-a381-4625-9050-afd3f42a3581 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:08.689502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0f15415-a381-4625-9050-afd3f42a3581 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:08.689954 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0f15415-a381-4625-9050-afd3f42a3581 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:08.690800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0f15415-a381-4625-9050-afd3f42a3581 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:08.691240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0f15415-a381-4625-9050-afd3f42a3581 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:08.728759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0f15415-a381-4625-9050-afd3f42a3581 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052360 May 10 14:35:08.729324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 587/1278] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:09.741019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d7b76d6-a6ea-4424-9509-8613172c37ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:09.742048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2d7b76d6-a6ea-4424-9509-8613172c37ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:09.748235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d7b76d6-a6ea-4424-9509-8613172c37ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:09.748695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d7b76d6-a6ea-4424-9509-8613172c37ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:09.749472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d7b76d6-a6ea-4424-9509-8613172c37ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:09.749948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d7b76d6-a6ea-4424-9509-8613172c37ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:09.781127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2d7b76d6-a6ea-4424-9509-8613172c37ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 May 10 14:35:09.781706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 692/1279] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:10.793580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9a40be6-d906-4163-bd98-9eb4934f2d31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:10.794560 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9a40be6-d906-4163-bd98-9eb4934f2d31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:10.801313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a40be6-d906-4163-bd98-9eb4934f2d31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:10.801767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a40be6-d906-4163-bd98-9eb4934f2d31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:10.802581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a40be6-d906-4163-bd98-9eb4934f2d31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:10.803021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a40be6-d906-4163-bd98-9eb4934f2d31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:10.833466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9a40be6-d906-4163-bd98-9eb4934f2d31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 May 10 14:35:10.834030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 588/1280] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:10.969358 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-960079332", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e3b58d-1cf0-42df-b72b-500ddf896ce1"}], "security_groups": [{"name": "tempest-securitygroup--883458275"}], "key_name": "tempest-keypair-332434994", "user_data": "}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:35:11.074964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] validate_networks() for [('d4e3b58d-1cf0-42df-b72b-500ddf896ce1', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:35:11.508862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:35:11.509318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:35:11.510000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:35:11.510438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:35:11.510852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:35:11.520300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:11.520745 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:11.521652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:11.522069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:11.541989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:35:11.546456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Getting quotas for user 9dae4d7a57f343c8bb7b92dbebea181d and project 8549d2b7b890411f878fe6fe776e65d7. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:35:11.557810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:35:11.560729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:35:11.802919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-17b24d20-350d-4144-9a39-496e55edf306 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.839224 May 10 14:35:11.803481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 693/1281] 10.222.0.58 () {62 vars in 1187 bytes} [Tue May 10 14:35:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 14:35:11.814166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1fbb51df-b072-4f66-833f-c0af4798d467 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:11.814908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1fbb51df-b072-4f66-833f-c0af4798d467 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:11.846627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-40ccc313-7d26-4a59-b46c-8c1db9950013 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:11.848100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-40ccc313-7d26-4a59-b46c-8c1db9950013 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:11.855261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40ccc313-7d26-4a59-b46c-8c1db9950013 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:11.855493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40ccc313-7d26-4a59-b46c-8c1db9950013 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:11.856278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40ccc313-7d26-4a59-b46c-8c1db9950013 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:11.856721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40ccc313-7d26-4a59-b46c-8c1db9950013 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:11.871155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1fbb51df-b072-4f66-833f-c0af4798d467 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:11.880696 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1fbb51df-b072-4f66-833f-c0af4798d467 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:11.882225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1fbb51df-b072-4f66-833f-c0af4798d467 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:11.883332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1fbb51df-b072-4f66-833f-c0af4798d467 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1280 microversion: 2.20 time: 0.073691 May 10 14:35:11.884068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 589/1282] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:11 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:11.898086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-40ccc313-7d26-4a59-b46c-8c1db9950013 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056368 May 10 14:35:11.898872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 694/1283] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:11 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:12.902187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:12.902862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:12.909020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:12.909472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:12.910314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:12.910547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-570f9a1f-2562-45d6-b333-1d12733e4498 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:12.911012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:12.911849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-570f9a1f-2562-45d6-b333-1d12733e4498 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:12.920778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-570f9a1f-2562-45d6-b333-1d12733e4498 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:12.921510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-570f9a1f-2562-45d6-b333-1d12733e4498 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:12.922869 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-570f9a1f-2562-45d6-b333-1d12733e4498 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:12.923724 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-570f9a1f-2562-45d6-b333-1d12733e4498 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:12.967935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-570f9a1f-2562-45d6-b333-1d12733e4498 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061322 May 10 14:35:12.968523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 695/1284] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:12.986282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:12.995018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:12.996562 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:12.998399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56ffeff5-53aa-4cdf-bb73-b49a76da918d tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1284 microversion: 2.20 time: 0.099886 May 10 14:35:13.003351 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 590/1285] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:12 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:13.979663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-99507787-e67d-45c5-b41d-adc21cead648 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:13.980555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-99507787-e67d-45c5-b41d-adc21cead648 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:13.987474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99507787-e67d-45c5-b41d-adc21cead648 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:13.987925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99507787-e67d-45c5-b41d-adc21cead648 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:13.988691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99507787-e67d-45c5-b41d-adc21cead648 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:13.989126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99507787-e67d-45c5-b41d-adc21cead648 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:14.022451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:14.023440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:14.027230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-99507787-e67d-45c5-b41d-adc21cead648 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050953 May 10 14:35:14.027837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 696/1286] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:14.033027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:14.033781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:14.034904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:14.035619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:14.116844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:14.126668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:14.128223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:14.129707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-727b6c8d-cad1-4824-a592-04e882c75484 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1332 microversion: 2.20 time: 0.113083 May 10 14:35:14.130278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 591/1287] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:14 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:15.039744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-90ea265c-2ab1-4974-9e60-eaa41ee18938 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:15.040732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-90ea265c-2ab1-4974-9e60-eaa41ee18938 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:15.048865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90ea265c-2ab1-4974-9e60-eaa41ee18938 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:15.049320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90ea265c-2ab1-4974-9e60-eaa41ee18938 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:15.050122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90ea265c-2ab1-4974-9e60-eaa41ee18938 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:15.050594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90ea265c-2ab1-4974-9e60-eaa41ee18938 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:15.085237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-90ea265c-2ab1-4974-9e60-eaa41ee18938 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048993 May 10 14:35:15.085237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 697/1288] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:15.150943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:15.152382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:15.158557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:15.159009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:15.159847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:15.160278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:15.238641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:15.246980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:15.248552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:15.249686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-319d561c-050d-4dd7-9886-8a08aab03e61 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1338 microversion: 2.20 time: 0.102724 May 10 14:35:15.250269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 592/1289] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:15 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:35:16.097407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ac454a41-e062-44b7-9e00-55704f00fb27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:16.098297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac454a41-e062-44b7-9e00-55704f00fb27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:16.104588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac454a41-e062-44b7-9e00-55704f00fb27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:16.105040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac454a41-e062-44b7-9e00-55704f00fb27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:16.105867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac454a41-e062-44b7-9e00-55704f00fb27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:16.106298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac454a41-e062-44b7-9e00-55704f00fb27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:16.137316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ac454a41-e062-44b7-9e00-55704f00fb27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 May 10 14:35:16.143788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 698/1290] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:16.271062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:16.271766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:16.277590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:16.278099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:16.278880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:16.279311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:16.440868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:16.451468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:16.453061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:16.454547 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-917d2d12-6c3a-491e-85ef-24c868d9a778 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.188090 May 10 14:35:16.455114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 593/1291] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:16 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:16.749756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-38fd14f5-938e-4c6d-b3d3-dd564ae8e2f7 req-a5d58ea7-ec37-4c85-af47-300828d2bf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49da3bbb-c3f4-4beb-8c62-d2a44c42d23f", "tag": "b1212718-e07e-4853-ae17-f09246be6825"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:35:16.758654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-38fd14f5-938e-4c6d-b3d3-dd564ae8e2f7 req-a5d58ea7-ec37-4c85-af47-300828d2bf69 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:16.759305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-38fd14f5-938e-4c6d-b3d3-dd564ae8e2f7 req-a5d58ea7-ec37-4c85-af47-300828d2bf69 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:16.772178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-38fd14f5-938e-4c6d-b3d3-dd564ae8e2f7 req-a5d58ea7-ec37-4c85-af47-300828d2bf69 service nova] Creating event network-changed:b1212718-e07e-4853-ae17-f09246be6825 for instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f on hv-cinder-84112 May 10 14:35:16.777790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-38fd14f5-938e-4c6d-b3d3-dd564ae8e2f7 req-a5d58ea7-ec37-4c85-af47-300828d2bf69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111958 May 10 14:35:16.778445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 699/1292] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:17.151781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b3b4a6c-85ea-4383-ac24-327cd20bcdde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:17.152856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4b3b4a6c-85ea-4383-ac24-327cd20bcdde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:17.159007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b3b4a6c-85ea-4383-ac24-327cd20bcdde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:17.159464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b3b4a6c-85ea-4383-ac24-327cd20bcdde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:17.160243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b3b4a6c-85ea-4383-ac24-327cd20bcdde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:17.160677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b3b4a6c-85ea-4383-ac24-327cd20bcdde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:17.195395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b3b4a6c-85ea-4383-ac24-327cd20bcdde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047592 May 10 14:35:17.195978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 594/1293] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:17.476119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:17.476818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:17.484202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:17.485008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:17.487112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:17.487558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:17.637826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:17.646408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:17.648054 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:17.649185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ff1a6024-8f3e-41cb-ba34-70413f7799f4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.177370 May 10 14:35:17.649737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 700/1294] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:17 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:18.208995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44994193-038d-47a0-9384-069d31cbd3fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:18.209923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44994193-038d-47a0-9384-069d31cbd3fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:18.216927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44994193-038d-47a0-9384-069d31cbd3fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:18.217374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44994193-038d-47a0-9384-069d31cbd3fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:18.218189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44994193-038d-47a0-9384-069d31cbd3fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:18.218656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44994193-038d-47a0-9384-069d31cbd3fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:18.251886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44994193-038d-47a0-9384-069d31cbd3fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 May 10 14:35:18.253381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 595/1295] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:18.667730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:18.669013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:18.675592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:18.676046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:18.676819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:18.677252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:18.811719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:18.820028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:18.821517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:18.822655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e55f43d3-569c-4e2d-89fe-386e99f3abfc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.158793 May 10 14:35:18.823198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 701/1296] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:18 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:19.272539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e8dd123-6858-4a57-85b9-f6b0b323e416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:19.273533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e8dd123-6858-4a57-85b9-f6b0b323e416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:19.280330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e8dd123-6858-4a57-85b9-f6b0b323e416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:19.280788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e8dd123-6858-4a57-85b9-f6b0b323e416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:19.281607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e8dd123-6858-4a57-85b9-f6b0b323e416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:19.282041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e8dd123-6858-4a57-85b9-f6b0b323e416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:19.312034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e8dd123-6858-4a57-85b9-f6b0b323e416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 May 10 14:35:19.312591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 596/1297] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:19.841935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:19.842547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:19.849363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:19.849815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:19.850635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:19.851072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:19.997755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:20.006056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:20.007672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:20.008772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f04b47fa-7fe6-4236-a054-ee95df908047 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.171105 May 10 14:35:20.009339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 702/1298] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:19 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:20.323291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64e37227-930b-4cdb-a6e1-55f29e4d9a8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:20.324232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64e37227-930b-4cdb-a6e1-55f29e4d9a8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:20.330526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e37227-930b-4cdb-a6e1-55f29e4d9a8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:20.330983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e37227-930b-4cdb-a6e1-55f29e4d9a8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:20.331788 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e37227-930b-4cdb-a6e1-55f29e4d9a8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:20.332263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e37227-930b-4cdb-a6e1-55f29e4d9a8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:20.362936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64e37227-930b-4cdb-a6e1-55f29e4d9a8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 May 10 14:35:20.363506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 597/1299] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:21.029367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:21.029916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:21.036265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:21.036707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:21.037469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:21.037903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:21.171984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:21.179933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:21.181420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:21.182557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-13f07504-7ff4-44cb-9be3-5ad9d7c7b4e4 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.158117 May 10 14:35:21.183178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 703/1300] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:21 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:21.375485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ae3c0ba0-c692-45de-87ef-f545dad67086 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:21.376414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ae3c0ba0-c692-45de-87ef-f545dad67086 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:21.382886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae3c0ba0-c692-45de-87ef-f545dad67086 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:21.383339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae3c0ba0-c692-45de-87ef-f545dad67086 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:21.384319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae3c0ba0-c692-45de-87ef-f545dad67086 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:21.384762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae3c0ba0-c692-45de-87ef-f545dad67086 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:21.414900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ae3c0ba0-c692-45de-87ef-f545dad67086 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 May 10 14:35:21.415473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 598/1301] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:22.133001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-aba4d250-12c2-4835-b41f-4688e8395641 req-fc808a4b-adbf-4f43-aa97-4f3748ddf23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49da3bbb-c3f4-4beb-8c62-d2a44c42d23f", "name": "network-vif-plugged", "status": "completed", "tag": "b1212718-e07e-4853-ae17-f09246be6825"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:35:22.141087 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-aba4d250-12c2-4835-b41f-4688e8395641 req-fc808a4b-adbf-4f43-aa97-4f3748ddf23e service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:22.141523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-aba4d250-12c2-4835-b41f-4688e8395641 req-fc808a4b-adbf-4f43-aa97-4f3748ddf23e service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:22.155144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-aba4d250-12c2-4835-b41f-4688e8395641 req-fc808a4b-adbf-4f43-aa97-4f3748ddf23e service nova] Creating event network-vif-plugged:b1212718-e07e-4853-ae17-f09246be6825 for instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f on hv-cinder-84112 May 10 14:35:22.160643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-aba4d250-12c2-4835-b41f-4688e8395641 req-fc808a4b-adbf-4f43-aa97-4f3748ddf23e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094610 May 10 14:35:22.161305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 704/1302] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:22.201326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:22.201936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:22.210044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:22.210951 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:22.211745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:22.212181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:22.374493 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:22.383138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:22.384975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:22.386823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0634b923-8e2a-4f4c-8147-08ce6baedaa2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.190287 May 10 14:35:22.387725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 599/1303] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:22 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:35:22.428109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e41f40f-3236-4b27-8188-7349f2e09a7d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:22.429188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e41f40f-3236-4b27-8188-7349f2e09a7d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:22.436265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e41f40f-3236-4b27-8188-7349f2e09a7d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:22.437818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e41f40f-3236-4b27-8188-7349f2e09a7d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:22.437818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e41f40f-3236-4b27-8188-7349f2e09a7d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:22.438032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e41f40f-3236-4b27-8188-7349f2e09a7d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:22.468060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e41f40f-3236-4b27-8188-7349f2e09a7d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 May 10 14:35:22.468551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 705/1304] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:22 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:23.408252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:23.408837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:23.414907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:23.415352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:23.416126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:23.416557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:23.481013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e00217ce-d59d-4595-b0c7-f9ed2414ddb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:23.482073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e00217ce-d59d-4595-b0c7-f9ed2414ddb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:23.488409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00217ce-d59d-4595-b0c7-f9ed2414ddb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:23.488857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00217ce-d59d-4595-b0c7-f9ed2414ddb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:23.489629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00217ce-d59d-4595-b0c7-f9ed2414ddb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:23.490129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00217ce-d59d-4595-b0c7-f9ed2414ddb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:23.521695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e00217ce-d59d-4595-b0c7-f9ed2414ddb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045198 May 10 14:35:23.522811 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 706/1305] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:23.554726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:23.562789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:23.564312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:23.565430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb3a0686-4d85-4939-a34c-484a182384f8 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.161120 May 10 14:35:23.565990 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 600/1306] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:23 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:24.535307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c9ff3841-d74d-4e0d-9d88-5aa4d95996de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:24.536176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c9ff3841-d74d-4e0d-9d88-5aa4d95996de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:24.542671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9ff3841-d74d-4e0d-9d88-5aa4d95996de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:24.543126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9ff3841-d74d-4e0d-9d88-5aa4d95996de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:24.543919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9ff3841-d74d-4e0d-9d88-5aa4d95996de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:24.544363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9ff3841-d74d-4e0d-9d88-5aa4d95996de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:24.577979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c9ff3841-d74d-4e0d-9d88-5aa4d95996de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046758 May 10 14:35:24.578626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 707/1307] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:24.584540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:24.585146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:24.591883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:24.592329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:24.593114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:24.593543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:24.733598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:24.742176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:24.743722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:24.745587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44427998-29f2-4d7e-b91f-d7ac5c78fdbd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1405 microversion: 2.20 time: 0.164198 May 10 14:35:24.745959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 601/1308] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:24 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:25.590042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2bb9d060-b701-4fc3-b4ff-c7cd07b04678 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:25.590906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2bb9d060-b701-4fc3-b4ff-c7cd07b04678 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:25.598009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb9d060-b701-4fc3-b4ff-c7cd07b04678 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:25.598488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb9d060-b701-4fc3-b4ff-c7cd07b04678 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:25.599259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb9d060-b701-4fc3-b4ff-c7cd07b04678 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:25.599687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bb9d060-b701-4fc3-b4ff-c7cd07b04678 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:25.631748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2bb9d060-b701-4fc3-b4ff-c7cd07b04678 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045457 May 10 14:35:25.632417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 708/1309] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:25.764025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:25.764631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:25.771259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:25.771780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:25.772856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:25.773550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:25.922822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:25.932791 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:25.934718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:25.935925 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2297716-3c4b-45bd-a0ef-9c3f3820ddb2 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1596 microversion: 2.20 time: 0.176466 May 10 14:35:25.936495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 602/1310] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:35:25 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1596 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:35:25.954657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f79e8867-4879-44bc-bb50-48dae7dd5ebd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:25.955492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f79e8867-4879-44bc-bb50-48dae7dd5ebd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:25.961977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f79e8867-4879-44bc-bb50-48dae7dd5ebd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:25.962470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f79e8867-4879-44bc-bb50-48dae7dd5ebd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:25.963293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f79e8867-4879-44bc-bb50-48dae7dd5ebd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:25.963744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f79e8867-4879-44bc-bb50-48dae7dd5ebd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:26.065417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f79e8867-4879-44bc-bb50-48dae7dd5ebd tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.114608 May 10 14:35:26.065993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 709/1311] 10.222.0.58 () {60 vars in 1315 bytes} [Tue May 10 14:35:25 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:35:26.647474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4530bd0e-8a48-4d3c-920b-c08c34fe0cd3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:26.648289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4530bd0e-8a48-4d3c-920b-c08c34fe0cd3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:26.659009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4530bd0e-8a48-4d3c-920b-c08c34fe0cd3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:26.659458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4530bd0e-8a48-4d3c-920b-c08c34fe0cd3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:26.660231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4530bd0e-8a48-4d3c-920b-c08c34fe0cd3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:26.660662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4530bd0e-8a48-4d3c-920b-c08c34fe0cd3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:26.701490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4530bd0e-8a48-4d3c-920b-c08c34fe0cd3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060951 May 10 14:35:26.702395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 603/1312] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:27.438486 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-50216644-b82e-4a7a-9dc6-eae710d2fbae req-ee2fbd8f-6490-4960-934c-439d34f810d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49da3bbb-c3f4-4beb-8c62-d2a44c42d23f", "tag": "b1212718-e07e-4853-ae17-f09246be6825"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:35:27.447018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-50216644-b82e-4a7a-9dc6-eae710d2fbae req-ee2fbd8f-6490-4960-934c-439d34f810d0 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:27.448352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-50216644-b82e-4a7a-9dc6-eae710d2fbae req-ee2fbd8f-6490-4960-934c-439d34f810d0 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:27.460342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-50216644-b82e-4a7a-9dc6-eae710d2fbae req-ee2fbd8f-6490-4960-934c-439d34f810d0 service nova] Creating event network-changed:b1212718-e07e-4853-ae17-f09246be6825 for instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f on hv-cinder-84112 May 10 14:35:27.465190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-50216644-b82e-4a7a-9dc6-eae710d2fbae req-ee2fbd8f-6490-4960-934c-439d34f810d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030803 May 10 14:35:27.467105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 710/1313] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:27.713191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b840121-691c-445f-8025-ad9e2aed4f9f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:27.715077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b840121-691c-445f-8025-ad9e2aed4f9f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:27.723271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b840121-691c-445f-8025-ad9e2aed4f9f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:27.723933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b840121-691c-445f-8025-ad9e2aed4f9f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:27.724743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b840121-691c-445f-8025-ad9e2aed4f9f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:27.725354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b840121-691c-445f-8025-ad9e2aed4f9f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:27.757209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b840121-691c-445f-8025-ad9e2aed4f9f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047968 May 10 14:35:27.757689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 604/1314] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:28.769785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ae91705-4857-4185-a7ab-e411174b7287 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:28.782717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ae91705-4857-4185-a7ab-e411174b7287 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:28.782717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae91705-4857-4185-a7ab-e411174b7287 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:28.782717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae91705-4857-4185-a7ab-e411174b7287 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:28.782717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae91705-4857-4185-a7ab-e411174b7287 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:28.783081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ae91705-4857-4185-a7ab-e411174b7287 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:28.809890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ae91705-4857-4185-a7ab-e411174b7287 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 May 10 14:35:28.810486 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 711/1315] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:29.821223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f1390c7-8b66-44e7-b522-17f58b1b0dcc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:29.822651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f1390c7-8b66-44e7-b522-17f58b1b0dcc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:29.828893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1390c7-8b66-44e7-b522-17f58b1b0dcc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:29.829346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1390c7-8b66-44e7-b522-17f58b1b0dcc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:29.830157 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1390c7-8b66-44e7-b522-17f58b1b0dcc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:29.830707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1390c7-8b66-44e7-b522-17f58b1b0dcc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:29.860816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f1390c7-8b66-44e7-b522-17f58b1b0dcc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 May 10 14:35:29.861445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 605/1316] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:30.875151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-94c78092-997e-43a1-918a-fce5100c44de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:30.876328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94c78092-997e-43a1-918a-fce5100c44de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:30.882729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c78092-997e-43a1-918a-fce5100c44de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:30.883169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c78092-997e-43a1-918a-fce5100c44de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:30.883925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c78092-997e-43a1-918a-fce5100c44de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:30.884702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c78092-997e-43a1-918a-fce5100c44de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:30.920524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-94c78092-997e-43a1-918a-fce5100c44de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051519 May 10 14:35:30.921090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 712/1317] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:31.933308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42ec4046-c599-403f-ace1-119f2a2d8cd5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:31.934258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42ec4046-c599-403f-ace1-119f2a2d8cd5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:31.940322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42ec4046-c599-403f-ace1-119f2a2d8cd5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:31.940768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42ec4046-c599-403f-ace1-119f2a2d8cd5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:31.941533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42ec4046-c599-403f-ace1-119f2a2d8cd5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:31.941973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42ec4046-c599-403f-ace1-119f2a2d8cd5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:31.972388 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42ec4046-c599-403f-ace1-119f2a2d8cd5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043888 May 10 14:35:31.972944 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 606/1318] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:31 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:32.984245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b533b16c-04d7-4805-a883-287eab5d6410 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:32.985089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b533b16c-04d7-4805-a883-287eab5d6410 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:32.991403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b533b16c-04d7-4805-a883-287eab5d6410 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:32.991855 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b533b16c-04d7-4805-a883-287eab5d6410 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:32.992677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b533b16c-04d7-4805-a883-287eab5d6410 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:32.993155 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b533b16c-04d7-4805-a883-287eab5d6410 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:33.022017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b533b16c-04d7-4805-a883-287eab5d6410 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 May 10 14:35:33.022608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 713/1319] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:34.035094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d02031b-0d09-45de-84cb-40aec2293991 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:34.036005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d02031b-0d09-45de-84cb-40aec2293991 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:34.042659 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d02031b-0d09-45de-84cb-40aec2293991 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:34.043106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d02031b-0d09-45de-84cb-40aec2293991 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:34.043871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d02031b-0d09-45de-84cb-40aec2293991 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:34.044297 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d02031b-0d09-45de-84cb-40aec2293991 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:34.072910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d02031b-0d09-45de-84cb-40aec2293991 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041850 May 10 14:35:34.073460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 607/1320] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:35.084675 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e13db081-7ef3-4495-801d-5db9bb256f5c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:35.085725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e13db081-7ef3-4495-801d-5db9bb256f5c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:35.093867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e13db081-7ef3-4495-801d-5db9bb256f5c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:35.093867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e13db081-7ef3-4495-801d-5db9bb256f5c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:35.095635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e13db081-7ef3-4495-801d-5db9bb256f5c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:35.095635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e13db081-7ef3-4495-801d-5db9bb256f5c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:35.127217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e13db081-7ef3-4495-801d-5db9bb256f5c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 May 10 14:35:35.127775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 714/1321] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:36.140333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-55f31546-4492-4ac5-8911-57f4027ada25 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:36.141271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-55f31546-4492-4ac5-8911-57f4027ada25 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:36.147232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f31546-4492-4ac5-8911-57f4027ada25 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:36.147669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f31546-4492-4ac5-8911-57f4027ada25 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:36.148421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f31546-4492-4ac5-8911-57f4027ada25 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:36.148878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f31546-4492-4ac5-8911-57f4027ada25 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:36.178575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-55f31546-4492-4ac5-8911-57f4027ada25 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 May 10 14:35:36.179139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 608/1322] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:36 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:37.190930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1d7a8fac-20fa-461a-8c66-4d8294a182ce tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:37.191958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1d7a8fac-20fa-461a-8c66-4d8294a182ce tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:37.200581 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d7a8fac-20fa-461a-8c66-4d8294a182ce tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:37.201031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d7a8fac-20fa-461a-8c66-4d8294a182ce tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:37.201794 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d7a8fac-20fa-461a-8c66-4d8294a182ce tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:37.202250 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d7a8fac-20fa-461a-8c66-4d8294a182ce tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:37.232899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1d7a8fac-20fa-461a-8c66-4d8294a182ce tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 May 10 14:35:37.233369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 715/1323] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:38.247291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62a52053-274c-4a6a-878e-0fdba1c95194 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:38.248192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62a52053-274c-4a6a-878e-0fdba1c95194 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:38.254632 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62a52053-274c-4a6a-878e-0fdba1c95194 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:38.255079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62a52053-274c-4a6a-878e-0fdba1c95194 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:38.255846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62a52053-274c-4a6a-878e-0fdba1c95194 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:38.256272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62a52053-274c-4a6a-878e-0fdba1c95194 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:38.287029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62a52053-274c-4a6a-878e-0fdba1c95194 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 May 10 14:35:38.287533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 609/1324] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:39.300375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bb233c47-f16c-4376-bdee-a35d7d73c1bc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:39.301297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bb233c47-f16c-4376-bdee-a35d7d73c1bc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:39.308405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb233c47-f16c-4376-bdee-a35d7d73c1bc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:39.308854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb233c47-f16c-4376-bdee-a35d7d73c1bc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:39.309635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb233c47-f16c-4376-bdee-a35d7d73c1bc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:39.310063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb233c47-f16c-4376-bdee-a35d7d73c1bc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:39.339950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bb233c47-f16c-4376-bdee-a35d7d73c1bc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 May 10 14:35:39.340508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 716/1325] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:40.352520 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf2869a4-c561-4ff1-8be1-d97bbb404e09 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:40.353451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf2869a4-c561-4ff1-8be1-d97bbb404e09 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:40.359468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf2869a4-c561-4ff1-8be1-d97bbb404e09 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:40.359917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf2869a4-c561-4ff1-8be1-d97bbb404e09 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:40.360691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf2869a4-c561-4ff1-8be1-d97bbb404e09 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:40.361123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf2869a4-c561-4ff1-8be1-d97bbb404e09 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:40.391703 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf2869a4-c561-4ff1-8be1-d97bbb404e09 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 May 10 14:35:40.392256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 610/1326] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:40 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:41.404014 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cf191f23-4c72-4432-a8da-2c596b176181 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:41.404944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cf191f23-4c72-4432-a8da-2c596b176181 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:41.412353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf191f23-4c72-4432-a8da-2c596b176181 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:41.412804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf191f23-4c72-4432-a8da-2c596b176181 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:41.413645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf191f23-4c72-4432-a8da-2c596b176181 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:41.414182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf191f23-4c72-4432-a8da-2c596b176181 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:41.443659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cf191f23-4c72-4432-a8da-2c596b176181 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 May 10 14:35:41.444147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 717/1327] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:42.456030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3942f97-382a-4bf3-b584-9570e2196bf1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:42.456964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3942f97-382a-4bf3-b584-9570e2196bf1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:42.463993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3942f97-382a-4bf3-b584-9570e2196bf1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:42.464445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3942f97-382a-4bf3-b584-9570e2196bf1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:42.465244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3942f97-382a-4bf3-b584-9570e2196bf1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:42.465661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3942f97-382a-4bf3-b584-9570e2196bf1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:42.497691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3942f97-382a-4bf3-b584-9570e2196bf1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 May 10 14:35:42.505485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 611/1328] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:43.512151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ea907de-30ed-45c0-bbed-107704251143 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:43.512987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ea907de-30ed-45c0-bbed-107704251143 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:43.519463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ea907de-30ed-45c0-bbed-107704251143 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:43.519907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ea907de-30ed-45c0-bbed-107704251143 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:43.520663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ea907de-30ed-45c0-bbed-107704251143 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:43.521090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ea907de-30ed-45c0-bbed-107704251143 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:43.558765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ea907de-30ed-45c0-bbed-107704251143 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051721 May 10 14:35:43.559340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 718/1329] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:43 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:44.571297 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7ac54c6-32c6-45e3-b511-756dd3e64a33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:44.572250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7ac54c6-32c6-45e3-b511-756dd3e64a33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:44.578443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7ac54c6-32c6-45e3-b511-756dd3e64a33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:44.578898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7ac54c6-32c6-45e3-b511-756dd3e64a33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:44.579685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7ac54c6-32c6-45e3-b511-756dd3e64a33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:44.580124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7ac54c6-32c6-45e3-b511-756dd3e64a33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:44.611979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7ac54c6-32c6-45e3-b511-756dd3e64a33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 May 10 14:35:44.612447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 612/1330] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:44 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:45.623837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cce3bfec-41b5-4ad8-9626-a9a25ece979f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:45.625008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cce3bfec-41b5-4ad8-9626-a9a25ece979f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:45.631525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cce3bfec-41b5-4ad8-9626-a9a25ece979f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:45.632671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cce3bfec-41b5-4ad8-9626-a9a25ece979f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:45.633490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cce3bfec-41b5-4ad8-9626-a9a25ece979f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:45.633961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cce3bfec-41b5-4ad8-9626-a9a25ece979f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:45.664259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cce3bfec-41b5-4ad8-9626-a9a25ece979f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 May 10 14:35:45.664753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 719/1331] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:46.675988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f808b55-4df6-430d-ab3c-7df08cbf7e14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:46.677014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f808b55-4df6-430d-ab3c-7df08cbf7e14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:46.683748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f808b55-4df6-430d-ab3c-7df08cbf7e14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:46.684200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f808b55-4df6-430d-ab3c-7df08cbf7e14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:46.684980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f808b55-4df6-430d-ab3c-7df08cbf7e14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:46.685414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f808b55-4df6-430d-ab3c-7df08cbf7e14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:46.719909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f808b55-4df6-430d-ab3c-7df08cbf7e14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 May 10 14:35:46.719909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 613/1332] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:46 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:47.728761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f00670b4-3868-421f-bb0e-b784606d210f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:47.730366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f00670b4-3868-421f-bb0e-b784606d210f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:47.737033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00670b4-3868-421f-bb0e-b784606d210f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:47.737487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00670b4-3868-421f-bb0e-b784606d210f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:47.738281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00670b4-3868-421f-bb0e-b784606d210f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:47.738719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00670b4-3868-421f-bb0e-b784606d210f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:47.767307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f00670b4-3868-421f-bb0e-b784606d210f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 May 10 14:35:47.767863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 720/1333] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:47 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:48.779014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73f37e75-3be9-4085-b886-03e60bba4f48 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:48.779930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73f37e75-3be9-4085-b886-03e60bba4f48 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:48.786288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73f37e75-3be9-4085-b886-03e60bba4f48 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:48.786740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73f37e75-3be9-4085-b886-03e60bba4f48 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:48.788526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73f37e75-3be9-4085-b886-03e60bba4f48 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:48.788959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73f37e75-3be9-4085-b886-03e60bba4f48 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:48.820326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73f37e75-3be9-4085-b886-03e60bba4f48 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 May 10 14:35:48.820879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 614/1334] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:49.832293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-383052e1-9362-4491-a92e-100de5b13a20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:49.833226 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-383052e1-9362-4491-a92e-100de5b13a20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:49.839958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383052e1-9362-4491-a92e-100de5b13a20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:49.840409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383052e1-9362-4491-a92e-100de5b13a20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:49.841195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383052e1-9362-4491-a92e-100de5b13a20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:49.841627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-383052e1-9362-4491-a92e-100de5b13a20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:49.871071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-383052e1-9362-4491-a92e-100de5b13a20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 May 10 14:35:49.871629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 721/1335] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:50.883451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2721a5f7-34c1-4491-a84f-fb2d16255653 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:50.884369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2721a5f7-34c1-4491-a84f-fb2d16255653 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:50.890375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2721a5f7-34c1-4491-a84f-fb2d16255653 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:50.890819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2721a5f7-34c1-4491-a84f-fb2d16255653 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:50.891588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2721a5f7-34c1-4491-a84f-fb2d16255653 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:50.892015 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2721a5f7-34c1-4491-a84f-fb2d16255653 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:50.922474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2721a5f7-34c1-4491-a84f-fb2d16255653 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 May 10 14:35:50.923021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 615/1336] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:50 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:51.935460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-94710efe-bfc7-4033-9fcc-5ef6a9e2f753 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:51.936389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94710efe-bfc7-4033-9fcc-5ef6a9e2f753 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:51.942764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94710efe-bfc7-4033-9fcc-5ef6a9e2f753 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:51.943270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94710efe-bfc7-4033-9fcc-5ef6a9e2f753 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:51.944123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94710efe-bfc7-4033-9fcc-5ef6a9e2f753 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:51.944555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94710efe-bfc7-4033-9fcc-5ef6a9e2f753 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:51.975105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-94710efe-bfc7-4033-9fcc-5ef6a9e2f753 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043005 May 10 14:35:51.975597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 722/1337] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:51 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:52.986728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3881e136-f967-4c72-925a-0a835ebead14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:52.987569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3881e136-f967-4c72-925a-0a835ebead14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:52.994475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3881e136-f967-4c72-925a-0a835ebead14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:52.994917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3881e136-f967-4c72-925a-0a835ebead14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:52.995691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3881e136-f967-4c72-925a-0a835ebead14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:52.996119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3881e136-f967-4c72-925a-0a835ebead14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:53.027466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3881e136-f967-4c72-925a-0a835ebead14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 May 10 14:35:53.028034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 616/1338] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:35:54.040517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fe377723-5f34-4cfe-a90e-9dfc49e6ef9d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:54.041380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fe377723-5f34-4cfe-a90e-9dfc49e6ef9d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:54.047954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe377723-5f34-4cfe-a90e-9dfc49e6ef9d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:54.048405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe377723-5f34-4cfe-a90e-9dfc49e6ef9d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:54.049187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe377723-5f34-4cfe-a90e-9dfc49e6ef9d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:54.049624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe377723-5f34-4cfe-a90e-9dfc49e6ef9d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:54.082784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fe377723-5f34-4cfe-a90e-9dfc49e6ef9d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047131 May 10 14:35:54.083423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 723/1339] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:54 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:55.100254 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16816df3-e032-4600-92eb-6a76f82c78e7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:55.101124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16816df3-e032-4600-92eb-6a76f82c78e7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:55.107094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16816df3-e032-4600-92eb-6a76f82c78e7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:55.107543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16816df3-e032-4600-92eb-6a76f82c78e7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:55.108313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16816df3-e032-4600-92eb-6a76f82c78e7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:55.108752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16816df3-e032-4600-92eb-6a76f82c78e7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:55.138999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16816df3-e032-4600-92eb-6a76f82c78e7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 May 10 14:35:55.139539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 617/1340] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:55 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:56.152164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffd70fed-dc09-489b-a068-5a9cbae63112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:56.153089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffd70fed-dc09-489b-a068-5a9cbae63112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:56.159424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffd70fed-dc09-489b-a068-5a9cbae63112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:56.159866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffd70fed-dc09-489b-a068-5a9cbae63112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:56.160623 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffd70fed-dc09-489b-a068-5a9cbae63112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:56.161246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffd70fed-dc09-489b-a068-5a9cbae63112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:56.189803 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffd70fed-dc09-489b-a068-5a9cbae63112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 May 10 14:35:56.190400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 724/1341] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:56.466001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:56.466573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:56.472349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:56.472790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:56.473605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:56.474484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:56.503847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:35:56.849262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-77366d32-3898-46ce-8076-3ec268b79dd6 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 204 len: 0 microversion: 2.1 time: 0.386901 May 10 14:35:56.849859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 618/1342] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:35:56 2022] DELETE /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:35:56.857993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:56.865905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:56.865905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:56.865905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:56.866293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:56.866468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:57.002373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:57.012418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b2250249-fd1c-4105-9da1-6493bff42530 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1554 microversion: 2.1 time: 0.157823 May 10 14:35:57.013316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 725/1343] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:35:56 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:35:57.201880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9318871b-af9b-4a0a-bf47-724580bce032 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:57.202940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9318871b-af9b-4a0a-bf47-724580bce032 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:57.209910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9318871b-af9b-4a0a-bf47-724580bce032 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:57.210399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9318871b-af9b-4a0a-bf47-724580bce032 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:57.211182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9318871b-af9b-4a0a-bf47-724580bce032 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:57.211614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9318871b-af9b-4a0a-bf47-724580bce032 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:57.241841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9318871b-af9b-4a0a-bf47-724580bce032 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 May 10 14:35:57.242424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 619/1344] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:58.030911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:58.031567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:58.038307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:58.038765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:58.039546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:58.040093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:58.206529 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:58.213414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-29b8660a-6ba3-4473-b472-839ddb8e6f81 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1554 microversion: 2.1 time: 0.186449 May 10 14:35:58.214183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 726/1345] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:35:58 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:35:58.253421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23ece79f-4c84-4ecb-a9ed-497ccfe3d81a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:58.255003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23ece79f-4c84-4ecb-a9ed-497ccfe3d81a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:58.261460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23ece79f-4c84-4ecb-a9ed-497ccfe3d81a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:58.261910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23ece79f-4c84-4ecb-a9ed-497ccfe3d81a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:58.262723 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23ece79f-4c84-4ecb-a9ed-497ccfe3d81a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:58.263161 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23ece79f-4c84-4ecb-a9ed-497ccfe3d81a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:58.296045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23ece79f-4c84-4ecb-a9ed-497ccfe3d81a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 May 10 14:35:58.296538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 620/1346] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:58.526537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-9063f6a9-683a-49c1-93a7-429a871856ec req-8b66f6db-0857-4383-9fef-bb72bb8c7947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c832da78-9dc2-4711-9fb1-907ac8dd7ffb", "name": "network-vif-deleted", "tag": "8d8a39d0-cb57-409d-acdc-1499da1a0722"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:35:58.535347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9063f6a9-683a-49c1-93a7-429a871856ec req-8b66f6db-0857-4383-9fef-bb72bb8c7947 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:58.535916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9063f6a9-683a-49c1-93a7-429a871856ec req-8b66f6db-0857-4383-9fef-bb72bb8c7947 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:58.547113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-9063f6a9-683a-49c1-93a7-429a871856ec req-8b66f6db-0857-4383-9fef-bb72bb8c7947 service nova] Creating event network-vif-deleted:8d8a39d0-cb57-409d-acdc-1499da1a0722 for instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb on hv-cinder-84112 May 10 14:35:58.552652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-9063f6a9-683a-49c1-93a7-429a871856ec req-8b66f6db-0857-4383-9fef-bb72bb8c7947 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 May 10 14:35:58.553792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 727/1347] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:35:59.230961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:59.239354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:59.239354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:59.239354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:59.239769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:59.240141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:59.270447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:59.271035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:59.271315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lazy-loading 'fault' on Instance uuid c832da78-9dc2-4711-9fb1-907ac8dd7ffb {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:35:59.309534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2a1797f8-16d7-498b-94d5-f57f4743e62b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:35:59.310971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2a1797f8-16d7-498b-94d5-f57f4743e62b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:35:59.313178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943d9591fc444280b105a088b32f4d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8324b5c8a0ad43b09a459a73d73dcf85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:35:59.317046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a1797f8-16d7-498b-94d5-f57f4743e62b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:59.317731 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a1797f8-16d7-498b-94d5-f57f4743e62b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:59.318717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a1797f8-16d7-498b-94d5-f57f4743e62b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:35:59.319377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a1797f8-16d7-498b-94d5-f57f4743e62b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:35:59.322916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ff6e06d-160e-49e3-98a2-3e56f5d00f6c tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 200 len: 1348 microversion: 2.1 time: 0.095984 May 10 14:35:59.323495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 621/1348] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:35:59 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:35:59.349190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2a1797f8-16d7-498b-94d5-f57f4743e62b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 May 10 14:35:59.349703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 728/1349] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:35:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:00.361332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-52e87969-3431-46c3-b9cb-7b98cdc392fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:00.362345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-52e87969-3431-46c3-b9cb-7b98cdc392fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:00.370137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52e87969-3431-46c3-b9cb-7b98cdc392fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:00.370622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52e87969-3431-46c3-b9cb-7b98cdc392fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:00.371410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52e87969-3431-46c3-b9cb-7b98cdc392fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:00.371842 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52e87969-3431-46c3-b9cb-7b98cdc392fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:00.405170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:00.405975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] [instance: c832da78-9dc2-4711-9fb1-907ac8dd7ffb] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:00.411468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-52e87969-3431-46c3-b9cb-7b98cdc392fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055218 May 10 14:36:00.412081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 729/1350] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:36:00.412432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:00.412896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:00.413708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:00.414147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:00.430096 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] HTTP exception thrown: Instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb could not be found. May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Request method failure captured: May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb HTTP/1.1 May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienSx96Amh9t247VDdJzdEiYDwwptdqsPq-CgamVAyCw3b1EThmIAIWQyFV54MX3Q6K8N-JsUTc0FQNI2hK9Mv13SQLnKBETwt-mFdaAw1B4bttF8LQzg2jXAFVtX-2DWjGs9KpPRJGDTPsZM12c9Ha5AgfKJ3ygnDWt_eoNKK61xhi0 May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 8324b5c8a0ad43b09a459a73d73dcf85 May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestMinimumBasicScenario-129696369 May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:36:00.431840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8324b5c8a0ad43b09a459a73d73dcf85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8324b5c8a0ad43b09a459a73d73dcf85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8324b5c8a0ad43b09a459a73d73dcf85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8324b5c8a0ad43b09a459a73d73dcf85"}]}] May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestMinimumBasicScenario-129696369 May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 8324b5c8a0ad43b09a459a73d73dcf85 May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestMinimumBasicScenario-129696369 May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-TestMinimumBasicScenario-129696369-project May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 943d9591fc444280b105a088b32f4d4e May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestMinimumBasicScenario-129696369-project May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb could not be found. May 10 14:36:00.434899 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'c832da78-9dc2-4711-9fb1-907ac8dd7ffb'} May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb could not be found. May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:36:00.436610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb could not be found. May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb could not be found. May 10 14:36:00.439830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:36:00.443744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Returning 404 to user: Instance c832da78-9dc2-4711-9fb1-907ac8dd7ffb could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:36:00.443744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-600ca225-2cb1-44e0-a350-5b22dbb6b544 tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb" status: 404 len: 111 microversion: 2.1 time: 0.096775 May 10 14:36:00.443744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 622/1351] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:36:00 2022] GET /compute/v2.1/servers/c832da78-9dc2-4711-9fb1-907ac8dd7ffb => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:36:00.444227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1a670238-762e-424a-abca-c1192d36b9fb tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] Calling method '.version_select at 0x7fef895561f0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:00.536137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1a670238-762e-424a-abca-c1192d36b9fb tempest-TestMinimumBasicScenario-129696369 tempest-TestMinimumBasicScenario-129696369-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-763989755" status: 202 len: 0 microversion: 2.1 time: 0.096844 May 10 14:36:00.536655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 730/1352] 10.222.0.58 () {58 vars in 1268 bytes} [Tue May 10 14:36:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-763989755 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:36:01.424030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a630e66-75c9-4d65-97d8-078836b633e0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:01.425141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a630e66-75c9-4d65-97d8-078836b633e0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:01.431699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a630e66-75c9-4d65-97d8-078836b633e0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:01.432149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a630e66-75c9-4d65-97d8-078836b633e0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:01.432943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a630e66-75c9-4d65-97d8-078836b633e0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:01.433377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a630e66-75c9-4d65-97d8-078836b633e0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:01.464039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a630e66-75c9-4d65-97d8-078836b633e0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 May 10 14:36:01.464584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 623/1353] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:02.477554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ec7b6e04-6c66-472e-a9a6-caab6d1bdd55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:02.478555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ec7b6e04-6c66-472e-a9a6-caab6d1bdd55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:02.484843 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec7b6e04-6c66-472e-a9a6-caab6d1bdd55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:02.485289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec7b6e04-6c66-472e-a9a6-caab6d1bdd55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:02.486058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec7b6e04-6c66-472e-a9a6-caab6d1bdd55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:02.486525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec7b6e04-6c66-472e-a9a6-caab6d1bdd55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:02.517636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ec7b6e04-6c66-472e-a9a6-caab6d1bdd55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 May 10 14:36:02.518212 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 731/1354] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:03.530410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f450ba5d-d4ae-41b6-9ebc-834fc9d270cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:03.532089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f450ba5d-d4ae-41b6-9ebc-834fc9d270cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:03.539532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f450ba5d-d4ae-41b6-9ebc-834fc9d270cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:03.539969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f450ba5d-d4ae-41b6-9ebc-834fc9d270cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:03.540768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f450ba5d-d4ae-41b6-9ebc-834fc9d270cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:03.541209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f450ba5d-d4ae-41b6-9ebc-834fc9d270cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:03.581502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f450ba5d-d4ae-41b6-9ebc-834fc9d270cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055863 May 10 14:36:03.582565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 624/1355] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:04.593756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-78d6a201-5831-4221-83ed-ca1ee025dd93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:04.595336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-78d6a201-5831-4221-83ed-ca1ee025dd93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:04.602699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d6a201-5831-4221-83ed-ca1ee025dd93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:04.603417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d6a201-5831-4221-83ed-ca1ee025dd93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:04.604372 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d6a201-5831-4221-83ed-ca1ee025dd93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:04.604968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d6a201-5831-4221-83ed-ca1ee025dd93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:04.644336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-78d6a201-5831-4221-83ed-ca1ee025dd93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046618 May 10 14:36:04.644336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 732/1356] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:05.654834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0912d80-f68d-4cc6-992b-e4a25fb582b1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:05.656432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0912d80-f68d-4cc6-992b-e4a25fb582b1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:05.663318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0912d80-f68d-4cc6-992b-e4a25fb582b1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:05.663763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0912d80-f68d-4cc6-992b-e4a25fb582b1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:05.664545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0912d80-f68d-4cc6-992b-e4a25fb582b1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:05.664978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0912d80-f68d-4cc6-992b-e4a25fb582b1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:05.703794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0912d80-f68d-4cc6-992b-e4a25fb582b1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053014 May 10 14:36:05.704980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 625/1357] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:06.716079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c585331d-ba61-46bd-89c6-5d296f52e096 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:06.717030 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c585331d-ba61-46bd-89c6-5d296f52e096 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:06.726655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c585331d-ba61-46bd-89c6-5d296f52e096 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:06.726655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c585331d-ba61-46bd-89c6-5d296f52e096 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:06.726655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c585331d-ba61-46bd-89c6-5d296f52e096 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:06.726655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c585331d-ba61-46bd-89c6-5d296f52e096 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:06.758942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c585331d-ba61-46bd-89c6-5d296f52e096 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 May 10 14:36:06.760359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 733/1358] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:07.775554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-651e4d3f-792b-47a1-8f38-056e871fba6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:07.778475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-651e4d3f-792b-47a1-8f38-056e871fba6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:07.785437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-651e4d3f-792b-47a1-8f38-056e871fba6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:07.786244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-651e4d3f-792b-47a1-8f38-056e871fba6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:07.787045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-651e4d3f-792b-47a1-8f38-056e871fba6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:07.787489 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-651e4d3f-792b-47a1-8f38-056e871fba6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:07.827095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-651e4d3f-792b-47a1-8f38-056e871fba6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059263 May 10 14:36:07.827478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 626/1359] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:36:08.846980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-11d08dfb-0ff6-400d-b2ed-f15d05a668da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:08.847914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-11d08dfb-0ff6-400d-b2ed-f15d05a668da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:08.854329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11d08dfb-0ff6-400d-b2ed-f15d05a668da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:08.854792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11d08dfb-0ff6-400d-b2ed-f15d05a668da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:08.855558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11d08dfb-0ff6-400d-b2ed-f15d05a668da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:08.856199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11d08dfb-0ff6-400d-b2ed-f15d05a668da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:08.888856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-11d08dfb-0ff6-400d-b2ed-f15d05a668da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 May 10 14:36:08.889801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 734/1360] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:09.900926 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1d20add-4484-4799-8cb1-7a4a413683b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:09.902546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1d20add-4484-4799-8cb1-7a4a413683b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:09.909253 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1d20add-4484-4799-8cb1-7a4a413683b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:09.909910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1d20add-4484-4799-8cb1-7a4a413683b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:09.910916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1d20add-4484-4799-8cb1-7a4a413683b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:09.911516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1d20add-4484-4799-8cb1-7a4a413683b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:09.941505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1d20add-4484-4799-8cb1-7a4a413683b6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 May 10 14:36:09.942324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 627/1361] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:10.953130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd6fff87-ff56-4c29-bac4-b5a8be650db6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:10.954070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd6fff87-ff56-4c29-bac4-b5a8be650db6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:10.960784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6fff87-ff56-4c29-bac4-b5a8be650db6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:10.961244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6fff87-ff56-4c29-bac4-b5a8be650db6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:10.962064 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6fff87-ff56-4c29-bac4-b5a8be650db6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:10.962490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6fff87-ff56-4c29-bac4-b5a8be650db6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:11.003019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd6fff87-ff56-4c29-bac4-b5a8be650db6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053258 May 10 14:36:11.003665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 735/1362] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:12.015092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd3cac46-9b22-471b-b7d4-4cbdfa304a0f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:12.016481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd3cac46-9b22-471b-b7d4-4cbdfa304a0f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:12.023069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd3cac46-9b22-471b-b7d4-4cbdfa304a0f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:12.023526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd3cac46-9b22-471b-b7d4-4cbdfa304a0f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:12.024326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd3cac46-9b22-471b-b7d4-4cbdfa304a0f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:12.024748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd3cac46-9b22-471b-b7d4-4cbdfa304a0f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:12.057323 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd3cac46-9b22-471b-b7d4-4cbdfa304a0f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 May 10 14:36:12.057890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 628/1363] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:13.072330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-969b218f-99df-48e4-83cc-a1364133ab8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:13.073226 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-969b218f-99df-48e4-83cc-a1364133ab8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:13.079732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-969b218f-99df-48e4-83cc-a1364133ab8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:13.081156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-969b218f-99df-48e4-83cc-a1364133ab8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:13.082410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-969b218f-99df-48e4-83cc-a1364133ab8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:13.082947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-969b218f-99df-48e4-83cc-a1364133ab8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:13.113079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-969b218f-99df-48e4-83cc-a1364133ab8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 May 10 14:36:13.113905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 736/1364] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:14.125488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-851f8afb-606d-4142-b4cb-5a31f68180de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:14.126570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-851f8afb-606d-4142-b4cb-5a31f68180de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:14.133497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-851f8afb-606d-4142-b4cb-5a31f68180de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:14.133945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-851f8afb-606d-4142-b4cb-5a31f68180de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:14.134767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-851f8afb-606d-4142-b4cb-5a31f68180de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:14.135203 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-851f8afb-606d-4142-b4cb-5a31f68180de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:14.175552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-851f8afb-606d-4142-b4cb-5a31f68180de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053593 May 10 14:36:14.176475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 629/1365] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:14 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:15.189267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8b3b9efc-f7da-4933-aeae-5bcdd2e0fc56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:15.190381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8b3b9efc-f7da-4933-aeae-5bcdd2e0fc56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:15.197093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b3b9efc-f7da-4933-aeae-5bcdd2e0fc56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:15.197544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b3b9efc-f7da-4933-aeae-5bcdd2e0fc56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:15.198423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b3b9efc-f7da-4933-aeae-5bcdd2e0fc56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:15.198862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b3b9efc-f7da-4933-aeae-5bcdd2e0fc56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:15.231682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8b3b9efc-f7da-4933-aeae-5bcdd2e0fc56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046553 May 10 14:36:15.232239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 737/1366] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:36:16.243034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25fb0ca3-3bd8-472e-8fcc-55272a80f720 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:16.243984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25fb0ca3-3bd8-472e-8fcc-55272a80f720 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:16.250375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25fb0ca3-3bd8-472e-8fcc-55272a80f720 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:16.250821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25fb0ca3-3bd8-472e-8fcc-55272a80f720 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:16.252598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25fb0ca3-3bd8-472e-8fcc-55272a80f720 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:16.253037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25fb0ca3-3bd8-472e-8fcc-55272a80f720 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:16.282800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25fb0ca3-3bd8-472e-8fcc-55272a80f720 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 May 10 14:36:16.283361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 630/1367] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:17.294135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2dd73478-bea0-46d5-9334-42db49377442 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:17.295100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2dd73478-bea0-46d5-9334-42db49377442 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:17.302094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dd73478-bea0-46d5-9334-42db49377442 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:17.302590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dd73478-bea0-46d5-9334-42db49377442 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:17.303363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dd73478-bea0-46d5-9334-42db49377442 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:17.303807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dd73478-bea0-46d5-9334-42db49377442 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:17.332274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2dd73478-bea0-46d5-9334-42db49377442 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 May 10 14:36:17.332833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 738/1368] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:18.349490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ef88166-31ff-490d-9fc4-e8d0b98446eb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:18.350432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ef88166-31ff-490d-9fc4-e8d0b98446eb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:18.356554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef88166-31ff-490d-9fc4-e8d0b98446eb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:18.357025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef88166-31ff-490d-9fc4-e8d0b98446eb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:18.357863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef88166-31ff-490d-9fc4-e8d0b98446eb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:18.358327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef88166-31ff-490d-9fc4-e8d0b98446eb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:18.395217 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ef88166-31ff-490d-9fc4-e8d0b98446eb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052737 May 10 14:36:18.395779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 631/1369] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:19.406831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93f66f29-32e1-47f5-897b-3697ad41f155 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:19.408647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93f66f29-32e1-47f5-897b-3697ad41f155 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:19.414911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93f66f29-32e1-47f5-897b-3697ad41f155 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:19.415350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93f66f29-32e1-47f5-897b-3697ad41f155 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:19.416102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93f66f29-32e1-47f5-897b-3697ad41f155 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:19.416529 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93f66f29-32e1-47f5-897b-3697ad41f155 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:19.444329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93f66f29-32e1-47f5-897b-3697ad41f155 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041417 May 10 14:36:19.444883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 739/1370] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:20.456510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6bdf53d2-aff8-44db-9469-8ab8dd8bc838 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:20.457517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6bdf53d2-aff8-44db-9469-8ab8dd8bc838 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:20.463480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf53d2-aff8-44db-9469-8ab8dd8bc838 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:20.463939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf53d2-aff8-44db-9469-8ab8dd8bc838 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:20.464702 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf53d2-aff8-44db-9469-8ab8dd8bc838 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:20.465138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bdf53d2-aff8-44db-9469-8ab8dd8bc838 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:20.493960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6bdf53d2-aff8-44db-9469-8ab8dd8bc838 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 May 10 14:36:20.494545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 632/1371] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:21.505573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b12f14fb-c429-4c57-9df7-9b367d655d91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:21.506547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b12f14fb-c429-4c57-9df7-9b367d655d91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:21.512905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12f14fb-c429-4c57-9df7-9b367d655d91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:21.513283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12f14fb-c429-4c57-9df7-9b367d655d91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:21.514050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12f14fb-c429-4c57-9df7-9b367d655d91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:21.514514 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12f14fb-c429-4c57-9df7-9b367d655d91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:21.543324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b12f14fb-c429-4c57-9df7-9b367d655d91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041719 May 10 14:36:21.543880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 740/1372] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:22.554958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e8000977-f05f-48f0-a7e8-1ea57863f9e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:22.555904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e8000977-f05f-48f0-a7e8-1ea57863f9e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:22.562305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8000977-f05f-48f0-a7e8-1ea57863f9e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:22.562762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8000977-f05f-48f0-a7e8-1ea57863f9e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:22.563935 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8000977-f05f-48f0-a7e8-1ea57863f9e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:22.564376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8000977-f05f-48f0-a7e8-1ea57863f9e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:22.593408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e8000977-f05f-48f0-a7e8-1ea57863f9e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 May 10 14:36:22.593958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 633/1373] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:22 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:23.606135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-59fae88d-7d06-412b-9ec2-33484e8a1f86 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:23.607091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-59fae88d-7d06-412b-9ec2-33484e8a1f86 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:23.614446 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59fae88d-7d06-412b-9ec2-33484e8a1f86 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:23.614898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59fae88d-7d06-412b-9ec2-33484e8a1f86 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:23.615671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59fae88d-7d06-412b-9ec2-33484e8a1f86 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:23.616105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59fae88d-7d06-412b-9ec2-33484e8a1f86 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:23.645600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-59fae88d-7d06-412b-9ec2-33484e8a1f86 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043461 May 10 14:36:23.646155 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 741/1374] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:24.658060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d4bbb27-9148-4fbe-bf55-f0afb807f19f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:24.659036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d4bbb27-9148-4fbe-bf55-f0afb807f19f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:24.665137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4bbb27-9148-4fbe-bf55-f0afb807f19f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:24.665586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4bbb27-9148-4fbe-bf55-f0afb807f19f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:24.666385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4bbb27-9148-4fbe-bf55-f0afb807f19f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:24.666818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4bbb27-9148-4fbe-bf55-f0afb807f19f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:24.700411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d4bbb27-9148-4fbe-bf55-f0afb807f19f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046786 May 10 14:36:24.701052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 634/1375] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:25.712278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60eb6f0e-5ddc-48e1-907f-0e26ef3c1976 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:25.713201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60eb6f0e-5ddc-48e1-907f-0e26ef3c1976 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:25.720289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60eb6f0e-5ddc-48e1-907f-0e26ef3c1976 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:25.720781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60eb6f0e-5ddc-48e1-907f-0e26ef3c1976 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:25.721531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60eb6f0e-5ddc-48e1-907f-0e26ef3c1976 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:25.722135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60eb6f0e-5ddc-48e1-907f-0e26ef3c1976 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:25.753694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60eb6f0e-5ddc-48e1-907f-0e26ef3c1976 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 May 10 14:36:25.754315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 742/1376] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:26.768418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3265c32-f2b2-4d97-987f-96120f7c0739 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:26.769495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3265c32-f2b2-4d97-987f-96120f7c0739 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:26.775827 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3265c32-f2b2-4d97-987f-96120f7c0739 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:26.776315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3265c32-f2b2-4d97-987f-96120f7c0739 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:26.777085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3265c32-f2b2-4d97-987f-96120f7c0739 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:26.777553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3265c32-f2b2-4d97-987f-96120f7c0739 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:26.809721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3265c32-f2b2-4d97-987f-96120f7c0739 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 May 10 14:36:26.810290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 635/1377] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:27.821024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3191c206-7ce0-4bee-a818-812454e6e473 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:27.822020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3191c206-7ce0-4bee-a818-812454e6e473 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:27.829055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3191c206-7ce0-4bee-a818-812454e6e473 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:27.829499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3191c206-7ce0-4bee-a818-812454e6e473 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:27.830320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3191c206-7ce0-4bee-a818-812454e6e473 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:27.830729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3191c206-7ce0-4bee-a818-812454e6e473 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:27.863628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3191c206-7ce0-4bee-a818-812454e6e473 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046495 May 10 14:36:27.864189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 743/1378] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:28.877155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e5c5a4b-729d-4bba-8078-ebebe3e8021b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:28.878080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e5c5a4b-729d-4bba-8078-ebebe3e8021b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:28.884269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e5c5a4b-729d-4bba-8078-ebebe3e8021b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:28.884542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e5c5a4b-729d-4bba-8078-ebebe3e8021b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:28.885330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e5c5a4b-729d-4bba-8078-ebebe3e8021b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:28.885770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e5c5a4b-729d-4bba-8078-ebebe3e8021b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:28.918052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e5c5a4b-729d-4bba-8078-ebebe3e8021b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 May 10 14:36:28.918631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 636/1379] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:29.929056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aa792356-3287-4b27-8d3a-5b649e19409b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:29.930080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aa792356-3287-4b27-8d3a-5b649e19409b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:29.936459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa792356-3287-4b27-8d3a-5b649e19409b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:29.936971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa792356-3287-4b27-8d3a-5b649e19409b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:29.937744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa792356-3287-4b27-8d3a-5b649e19409b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:29.938181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa792356-3287-4b27-8d3a-5b649e19409b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:29.967978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aa792356-3287-4b27-8d3a-5b649e19409b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 May 10 14:36:29.969691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 744/1380] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:36:30.980853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47547d21-b41d-4b0d-9f02-82c993370818 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:30.981678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47547d21-b41d-4b0d-9f02-82c993370818 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:30.988993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47547d21-b41d-4b0d-9f02-82c993370818 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:30.989493 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47547d21-b41d-4b0d-9f02-82c993370818 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:30.990359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47547d21-b41d-4b0d-9f02-82c993370818 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:30.990726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47547d21-b41d-4b0d-9f02-82c993370818 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:31.023636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47547d21-b41d-4b0d-9f02-82c993370818 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047076 May 10 14:36:31.024501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 637/1381] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:32.037627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5aef8c4a-f12c-4c1d-89c4-2d7020020c21 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:32.038490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5aef8c4a-f12c-4c1d-89c4-2d7020020c21 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:32.044880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aef8c4a-f12c-4c1d-89c4-2d7020020c21 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:32.045344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aef8c4a-f12c-4c1d-89c4-2d7020020c21 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:32.046634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aef8c4a-f12c-4c1d-89c4-2d7020020c21 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:32.047135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aef8c4a-f12c-4c1d-89c4-2d7020020c21 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:32.083215 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5aef8c4a-f12c-4c1d-89c4-2d7020020c21 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049592 May 10 14:36:32.086032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 745/1382] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:33.095575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5619ecbf-5bce-4fef-bf48-959a55ee1e7e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:33.096421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5619ecbf-5bce-4fef-bf48-959a55ee1e7e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:33.102821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5619ecbf-5bce-4fef-bf48-959a55ee1e7e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:33.103274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5619ecbf-5bce-4fef-bf48-959a55ee1e7e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:33.104095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5619ecbf-5bce-4fef-bf48-959a55ee1e7e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:33.104534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5619ecbf-5bce-4fef-bf48-959a55ee1e7e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:33.136957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5619ecbf-5bce-4fef-bf48-959a55ee1e7e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 May 10 14:36:33.137768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 638/1383] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:33 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:36:34.149244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a3405538-07dd-4dde-bb44-06ec3e3bda8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:34.150167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a3405538-07dd-4dde-bb44-06ec3e3bda8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:34.157371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3405538-07dd-4dde-bb44-06ec3e3bda8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:34.157814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3405538-07dd-4dde-bb44-06ec3e3bda8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:34.158639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3405538-07dd-4dde-bb44-06ec3e3bda8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:34.159074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3405538-07dd-4dde-bb44-06ec3e3bda8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:34.198995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a3405538-07dd-4dde-bb44-06ec3e3bda8a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053668 May 10 14:36:34.199570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 746/1384] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:35.211895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f82c3835-7d16-4f9a-9cf9-ef92c2bbb3af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:35.212844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f82c3835-7d16-4f9a-9cf9-ef92c2bbb3af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:35.219421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f82c3835-7d16-4f9a-9cf9-ef92c2bbb3af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:35.219867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f82c3835-7d16-4f9a-9cf9-ef92c2bbb3af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:35.220665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f82c3835-7d16-4f9a-9cf9-ef92c2bbb3af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:35.221065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f82c3835-7d16-4f9a-9cf9-ef92c2bbb3af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:35.252842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f82c3835-7d16-4f9a-9cf9-ef92c2bbb3af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 May 10 14:36:35.253408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 639/1385] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:36.266284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b68006d5-fbec-4cb0-9eb0-b3932c6b1798 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:36.267248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b68006d5-fbec-4cb0-9eb0-b3932c6b1798 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:36.274532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68006d5-fbec-4cb0-9eb0-b3932c6b1798 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:36.274991 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68006d5-fbec-4cb0-9eb0-b3932c6b1798 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:36.275773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68006d5-fbec-4cb0-9eb0-b3932c6b1798 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:36.276214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68006d5-fbec-4cb0-9eb0-b3932c6b1798 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:36.314628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b68006d5-fbec-4cb0-9eb0-b3932c6b1798 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053566 May 10 14:36:36.315217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 747/1386] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:36 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:37.328542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5dadb58b-8eb4-4359-988d-c3e6a05175b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:37.329613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5dadb58b-8eb4-4359-988d-c3e6a05175b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:37.340094 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dadb58b-8eb4-4359-988d-c3e6a05175b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:37.340765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dadb58b-8eb4-4359-988d-c3e6a05175b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:37.342718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dadb58b-8eb4-4359-988d-c3e6a05175b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:37.343186 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dadb58b-8eb4-4359-988d-c3e6a05175b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:37.373984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5dadb58b-8eb4-4359-988d-c3e6a05175b2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051365 May 10 14:36:37.374600 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 640/1387] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:38.385859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bacb2a56-7738-46bb-aa4c-07b5fd42e134 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:38.386835 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bacb2a56-7738-46bb-aa4c-07b5fd42e134 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:38.394875 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bacb2a56-7738-46bb-aa4c-07b5fd42e134 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:38.395144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bacb2a56-7738-46bb-aa4c-07b5fd42e134 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:38.395744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bacb2a56-7738-46bb-aa4c-07b5fd42e134 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:38.396184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bacb2a56-7738-46bb-aa4c-07b5fd42e134 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:38.431927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bacb2a56-7738-46bb-aa4c-07b5fd42e134 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050055 May 10 14:36:38.432512 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 748/1388] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:39.444346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e52aca0-10c3-4666-b462-01775b06428a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:39.445275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e52aca0-10c3-4666-b462-01775b06428a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:39.451626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e52aca0-10c3-4666-b462-01775b06428a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:39.452074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e52aca0-10c3-4666-b462-01775b06428a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:39.452866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e52aca0-10c3-4666-b462-01775b06428a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:39.453300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e52aca0-10c3-4666-b462-01775b06428a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:39.486817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e52aca0-10c3-4666-b462-01775b06428a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 May 10 14:36:39.487615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 641/1389] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:40.499550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-95b5fb1a-11aa-47a9-9c57-9fdd14dc45b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:40.500476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-95b5fb1a-11aa-47a9-9c57-9fdd14dc45b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:40.506504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95b5fb1a-11aa-47a9-9c57-9fdd14dc45b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:40.506957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95b5fb1a-11aa-47a9-9c57-9fdd14dc45b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:40.507727 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95b5fb1a-11aa-47a9-9c57-9fdd14dc45b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:40.512381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95b5fb1a-11aa-47a9-9c57-9fdd14dc45b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:40.540311 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-95b5fb1a-11aa-47a9-9c57-9fdd14dc45b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 May 10 14:36:40.540893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 749/1390] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:40 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:41.552152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d68a0ce3-6d82-4604-8b2f-b36845a3cd7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:41.552981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d68a0ce3-6d82-4604-8b2f-b36845a3cd7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:41.559243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68a0ce3-6d82-4604-8b2f-b36845a3cd7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:41.559685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68a0ce3-6d82-4604-8b2f-b36845a3cd7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:41.561369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68a0ce3-6d82-4604-8b2f-b36845a3cd7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:41.561833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68a0ce3-6d82-4604-8b2f-b36845a3cd7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:41.592050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d68a0ce3-6d82-4604-8b2f-b36845a3cd7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 May 10 14:36:41.592607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 642/1391] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:42.565210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-799cce60-8797-4dfe-a353-6e9a2f769717 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:42.565776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-799cce60-8797-4dfe-a353-6e9a2f769717 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:42.572246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799cce60-8797-4dfe-a353-6e9a2f769717 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:42.572692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799cce60-8797-4dfe-a353-6e9a2f769717 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:42.573470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799cce60-8797-4dfe-a353-6e9a2f769717 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:42.573897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799cce60-8797-4dfe-a353-6e9a2f769717 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:42.598375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-799cce60-8797-4dfe-a353-6e9a2f769717 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f/ips" status: 200 len: 151 microversion: 2.20 time: 0.037055 May 10 14:36:42.599109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 750/1392] 10.222.0.58 () {60 vars in 1288 bytes} [Tue May 10 14:36:42 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:36:42.607660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33155e86-2efb-47b2-9af0-ce7bfcd170a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:42.608618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33155e86-2efb-47b2-9af0-ce7bfcd170a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:42.615790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33155e86-2efb-47b2-9af0-ce7bfcd170a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:42.616251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33155e86-2efb-47b2-9af0-ce7bfcd170a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:42.617041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33155e86-2efb-47b2-9af0-ce7bfcd170a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:42.617477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33155e86-2efb-47b2-9af0-ce7bfcd170a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:42.658678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33155e86-2efb-47b2-9af0-ce7bfcd170a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057768 May 10 14:36:42.659518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 643/1393] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:43.672587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-903556d9-18f2-4ad2-aae0-30c10965d408 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:43.673513 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-903556d9-18f2-4ad2-aae0-30c10965d408 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:43.679844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-903556d9-18f2-4ad2-aae0-30c10965d408 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:43.680242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-903556d9-18f2-4ad2-aae0-30c10965d408 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:43.681008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-903556d9-18f2-4ad2-aae0-30c10965d408 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:43.681445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-903556d9-18f2-4ad2-aae0-30c10965d408 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:43.710412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-903556d9-18f2-4ad2-aae0-30c10965d408 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042407 May 10 14:36:43.710962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 751/1394] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:43 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:44.721257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c8516bf7-3ec2-45d6-a3e6-2f993a356c9c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:44.722586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c8516bf7-3ec2-45d6-a3e6-2f993a356c9c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:44.728238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8516bf7-3ec2-45d6-a3e6-2f993a356c9c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:44.728718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8516bf7-3ec2-45d6-a3e6-2f993a356c9c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:44.729481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8516bf7-3ec2-45d6-a3e6-2f993a356c9c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:44.729912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8516bf7-3ec2-45d6-a3e6-2f993a356c9c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:44.759735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c8516bf7-3ec2-45d6-a3e6-2f993a356c9c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 May 10 14:36:44.760277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 644/1395] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:44 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:45.771990 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-610bbd05-911c-4f89-b8bf-b641db65991d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:45.772968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-610bbd05-911c-4f89-b8bf-b641db65991d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:45.781186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-610bbd05-911c-4f89-b8bf-b641db65991d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:45.781885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-610bbd05-911c-4f89-b8bf-b641db65991d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:45.782737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-610bbd05-911c-4f89-b8bf-b641db65991d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:45.783964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-610bbd05-911c-4f89-b8bf-b641db65991d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:45.813313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-610bbd05-911c-4f89-b8bf-b641db65991d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 May 10 14:36:45.813877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 752/1396] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:46.824357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-633c3172-73bc-4364-ab2c-c20561ed2289 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:46.825829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-633c3172-73bc-4364-ab2c-c20561ed2289 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:46.831903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633c3172-73bc-4364-ab2c-c20561ed2289 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:46.832346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633c3172-73bc-4364-ab2c-c20561ed2289 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:46.833111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633c3172-73bc-4364-ab2c-c20561ed2289 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:46.833542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633c3172-73bc-4364-ab2c-c20561ed2289 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:46.862341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-633c3172-73bc-4364-ab2c-c20561ed2289 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 May 10 14:36:46.862885 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 645/1397] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:46 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:47.873808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dce42446-4a76-4391-a764-23aac2574413 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:47.874683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dce42446-4a76-4391-a764-23aac2574413 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:47.880636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce42446-4a76-4391-a764-23aac2574413 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:47.881092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce42446-4a76-4391-a764-23aac2574413 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:47.881860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce42446-4a76-4391-a764-23aac2574413 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:47.882327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce42446-4a76-4391-a764-23aac2574413 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:47.911556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dce42446-4a76-4391-a764-23aac2574413 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 May 10 14:36:47.912110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 753/1398] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:47 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:48.925782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4646eaa6-134b-41a5-8954-53eac57f7ca1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:48.927168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4646eaa6-134b-41a5-8954-53eac57f7ca1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:48.933378 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646eaa6-134b-41a5-8954-53eac57f7ca1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:48.933875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646eaa6-134b-41a5-8954-53eac57f7ca1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:48.935755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646eaa6-134b-41a5-8954-53eac57f7ca1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:48.936195 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646eaa6-134b-41a5-8954-53eac57f7ca1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:48.964561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4646eaa6-134b-41a5-8954-53eac57f7ca1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 May 10 14:36:48.965110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 646/1399] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:49.976674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd6af630-4c47-436d-80d7-2b9b81ff15b4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:49.977600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd6af630-4c47-436d-80d7-2b9b81ff15b4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:49.985315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6af630-4c47-436d-80d7-2b9b81ff15b4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:49.985761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6af630-4c47-436d-80d7-2b9b81ff15b4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:49.986568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6af630-4c47-436d-80d7-2b9b81ff15b4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:49.987099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd6af630-4c47-436d-80d7-2b9b81ff15b4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:50.017990 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd6af630-4c47-436d-80d7-2b9b81ff15b4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 May 10 14:36:50.018575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 754/1400] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:36:51.029155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-75830dba-f62f-4e30-a41f-8ee8325f2cef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:51.030102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-75830dba-f62f-4e30-a41f-8ee8325f2cef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:51.036090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75830dba-f62f-4e30-a41f-8ee8325f2cef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:51.036533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75830dba-f62f-4e30-a41f-8ee8325f2cef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:51.037346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75830dba-f62f-4e30-a41f-8ee8325f2cef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:51.037779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75830dba-f62f-4e30-a41f-8ee8325f2cef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:51.066498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-75830dba-f62f-4e30-a41f-8ee8325f2cef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 May 10 14:36:51.067050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 647/1401] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:51 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:52.079209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-557ff201-738b-4b12-935a-0223b521352e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:52.080236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-557ff201-738b-4b12-935a-0223b521352e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:52.086702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-557ff201-738b-4b12-935a-0223b521352e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:52.087144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-557ff201-738b-4b12-935a-0223b521352e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:52.087911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-557ff201-738b-4b12-935a-0223b521352e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:52.088342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-557ff201-738b-4b12-935a-0223b521352e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:52.119702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-557ff201-738b-4b12-935a-0223b521352e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 May 10 14:36:52.120266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 755/1402] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:53.132044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a241cd39-be42-4cd1-8ce0-5f9f1b6ee78b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:53.132997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a241cd39-be42-4cd1-8ce0-5f9f1b6ee78b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:53.140377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a241cd39-be42-4cd1-8ce0-5f9f1b6ee78b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:53.140823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a241cd39-be42-4cd1-8ce0-5f9f1b6ee78b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:53.141599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a241cd39-be42-4cd1-8ce0-5f9f1b6ee78b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:53.142039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a241cd39-be42-4cd1-8ce0-5f9f1b6ee78b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:53.174447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a241cd39-be42-4cd1-8ce0-5f9f1b6ee78b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046527 May 10 14:36:53.175005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 648/1403] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:53 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:54.186016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fe98caaa-29e2-4b49-9dc1-eb0bf2f90979 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:54.186958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fe98caaa-29e2-4b49-9dc1-eb0bf2f90979 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:54.193389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe98caaa-29e2-4b49-9dc1-eb0bf2f90979 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:54.193838 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe98caaa-29e2-4b49-9dc1-eb0bf2f90979 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:54.194628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe98caaa-29e2-4b49-9dc1-eb0bf2f90979 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:54.195063 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe98caaa-29e2-4b49-9dc1-eb0bf2f90979 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:54.224375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fe98caaa-29e2-4b49-9dc1-eb0bf2f90979 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042299 May 10 14:36:54.224920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 756/1404] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:54 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:55.236801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-18d3b217-79c9-4182-8e37-1128c94b997a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:55.237751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-18d3b217-79c9-4182-8e37-1128c94b997a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:55.244104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18d3b217-79c9-4182-8e37-1128c94b997a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:55.244642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18d3b217-79c9-4182-8e37-1128c94b997a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:55.245408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18d3b217-79c9-4182-8e37-1128c94b997a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:55.246567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18d3b217-79c9-4182-8e37-1128c94b997a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:55.274731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-18d3b217-79c9-4182-8e37-1128c94b997a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041853 May 10 14:36:55.275277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 649/1405] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:55 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:36:56.288385 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-166b13ab-5f9e-4dc9-bb2a-cb43c288bcea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:56.289344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-166b13ab-5f9e-4dc9-bb2a-cb43c288bcea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:56.295665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-166b13ab-5f9e-4dc9-bb2a-cb43c288bcea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:56.296113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-166b13ab-5f9e-4dc9-bb2a-cb43c288bcea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:56.296882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-166b13ab-5f9e-4dc9-bb2a-cb43c288bcea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:56.297319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-166b13ab-5f9e-4dc9-bb2a-cb43c288bcea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:56.327771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-166b13ab-5f9e-4dc9-bb2a-cb43c288bcea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 May 10 14:36:56.328328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 757/1406] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:57.340145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-175ef862-a776-41ad-be85-352674d50020 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:57.341112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-175ef862-a776-41ad-be85-352674d50020 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:57.347137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175ef862-a776-41ad-be85-352674d50020 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:57.347628 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175ef862-a776-41ad-be85-352674d50020 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:57.348403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175ef862-a776-41ad-be85-352674d50020 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:57.348840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-175ef862-a776-41ad-be85-352674d50020 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:57.377525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-175ef862-a776-41ad-be85-352674d50020 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 May 10 14:36:57.378073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 650/1407] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:58.388967 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-de92ea25-a331-4f45-94e1-605fb46b498a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:58.389886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-de92ea25-a331-4f45-94e1-605fb46b498a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:58.396161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de92ea25-a331-4f45-94e1-605fb46b498a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:58.396604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de92ea25-a331-4f45-94e1-605fb46b498a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:58.397360 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de92ea25-a331-4f45-94e1-605fb46b498a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:58.397789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de92ea25-a331-4f45-94e1-605fb46b498a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:58.430972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-de92ea25-a331-4f45-94e1-605fb46b498a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046289 May 10 14:36:58.431941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 758/1408] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:36:59.442567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac33730a-5d6f-4abc-9013-9f3dd9becfdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:36:59.443521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac33730a-5d6f-4abc-9013-9f3dd9becfdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:36:59.450301 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac33730a-5d6f-4abc-9013-9f3dd9becfdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:59.450720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac33730a-5d6f-4abc-9013-9f3dd9becfdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:59.451482 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac33730a-5d6f-4abc-9013-9f3dd9becfdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:36:59.451909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac33730a-5d6f-4abc-9013-9f3dd9becfdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:36:59.480876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac33730a-5d6f-4abc-9013-9f3dd9becfdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042244 May 10 14:36:59.481437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 651/1409] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:36:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:37:00.195591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:00.196120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:00.202530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:00.202982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:00.203738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:00.204166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:00.229178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:37:00.492063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fbc9bd89-163e-4593-938b-2f2636b97b88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:37:00.492984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fbc9bd89-163e-4593-938b-2f2636b97b88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:00.499442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbc9bd89-163e-4593-938b-2f2636b97b88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:00.500441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbc9bd89-163e-4593-938b-2f2636b97b88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:00.500684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbc9bd89-163e-4593-938b-2f2636b97b88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:00.501185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbc9bd89-163e-4593-938b-2f2636b97b88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:00.622064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fbc9bd89-163e-4593-938b-2f2636b97b88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/action" status: 200 len: 78514 microversion: 2.1 time: 0.133893 May 10 14:37:00.623097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 652/1410] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:37:00 2022] POST /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041/action => generated 78514 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:37:00.640961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4316873d-3d33-4a11-9075-70497ea67db0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 204 len: 0 microversion: 2.1 time: 0.448849 May 10 14:37:00.641564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 759/1411] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:37:00 2022] DELETE /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:37:00.650326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:00.651022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:00.658270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:00.658726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:00.659540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:00.659980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:00.960692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:00.968303 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9b4f279-496f-4749-84cd-38ed18ca7ef3 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1681 microversion: 2.1 time: 0.322179 May 10 14:37:00.968867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 653/1412] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:00 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:01.985725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:01.986363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:01.993368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:01.993818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:01.994909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:01.995338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:02.192955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:02.201004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e2eb3524-70ae-4ed9-a0fc-392c6ea82522 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1681 microversion: 2.1 time: 0.219650 May 10 14:37:02.201575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 760/1413] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:01 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:02.605361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-2cb7d0e4-b6a9-47e2-9ec6-e9ab7c5d7c00 req-55f8a95a-7a96-4d98-a5e2-c6ae487aea25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fb3f67-1347-46a8-aa95-3a656e9bc96f", "name": "network-vif-deleted", "tag": "e478792c-03b1-4423-b9b6-8194a3bf41c8"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:37:02.614949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2cb7d0e4-b6a9-47e2-9ec6-e9ab7c5d7c00 req-55f8a95a-7a96-4d98-a5e2-c6ae487aea25 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:02.615415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2cb7d0e4-b6a9-47e2-9ec6-e9ab7c5d7c00 req-55f8a95a-7a96-4d98-a5e2-c6ae487aea25 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:02.627287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-2cb7d0e4-b6a9-47e2-9ec6-e9ab7c5d7c00 req-55f8a95a-7a96-4d98-a5e2-c6ae487aea25 service nova] Creating event network-vif-deleted:e478792c-03b1-4423-b9b6-8194a3bf41c8 for instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f on hv-cinder-84112 May 10 14:37:02.634230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-2cb7d0e4-b6a9-47e2-9ec6-e9ab7c5d7c00 req-55f8a95a-7a96-4d98-a5e2-c6ae487aea25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033124 May 10 14:37:02.634837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 654/1414] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:37:03.222108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:03.223241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:03.235626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:03.236380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:03.237499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:03.238303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:03.277415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:03.278081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:03.278592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lazy-loading 'fault' on Instance uuid 51fb3f67-1347-46a8-aa95-3a656e9bc96f {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:37:03.337361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:03.348588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d4758fe-4c82-4fdf-a81c-3e297a0e7dd8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 200 len: 1331 microversion: 2.1 time: 0.131895 May 10 14:37:03.349178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 761/1415] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:03 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:04.372989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:04.373708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:04.380132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:04.380596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:04.381382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:04.381824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:04.395928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f HTTP/1.1 May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:37:04.397580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:37:04.399347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '51fb3f67-1347-46a8-aa95-3a656e9bc96f'} May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:37:04.400265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:37:04.402708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:37:04.404032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:37:04.404032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc1b198f-d3eb-4a0b-84d9-41b5dfd38505 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 404 len: 111 microversion: 2.1 time: 0.031365 May 10 14:37:04.404032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 655/1416] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:04 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:37:04.408882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1688eff0-de00-45d3-8d1b-22f99c165a68 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '.version_select at 0x7fef842d05e0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:04.516345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1688eff0-de00-45d3-8d1b-22f99c165a68 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842305705" status: 202 len: 0 microversion: 2.1 time: 0.111205 May 10 14:37:04.516850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 762/1417] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 10 14:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842305705 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:37:05.405390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f26848a-f737-4273-943b-3dff0c867245 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Action: 'create', calling method: .version_select at 0x7fef84372550>, body: {"keypair": {"name": "tempest-keypair-1059098717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITlcfmITLPE8t/TWIal2tBiOgmzX5ZQ8a4hLb0Z2LEr114G0YzG2kDTFJum8KHDPrd86aT5f3kctSVh+eGHvmTFJ22Oq3lBiYcB2r3LpGI0wgkUBlEcc9cVoHmm+c7+YA=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:37:05.418953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-5f26848a-f737-4273-943b-3dff0c867245 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:37:05.422811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-5f26848a-f737-4273-943b-3dff0c867245 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for user ecb4c97543e1452d8e6c8f1564addc76 and project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:37:05.515992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f26848a-f737-4273-943b-3dff0c867245 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115133 May 10 14:37:05.516668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 656/1418] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:37:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:37:08.446693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1393533475", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e5ec3c3-4d17-4222-ba80-44b733b6bca6"}], "security_groups": [{"name": "tempest-securitygroup--97428011"}], "key_name": "tempest-keypair-1059098717", "user_data": "}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:37:08.555066 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] validate_networks() for [('3e5ec3c3-4d17-4222-ba80-44b733b6bca6', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:37:08.947798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:37:08.948228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:37:08.948707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:37:08.949381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:37:08.949839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:37:08.958754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:08.959208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:08.960018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:08.960457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:08.977658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:37:08.982293 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Getting quotas for user ecb4c97543e1452d8e6c8f1564addc76 and project fc0e8bf4c69e49d1b4a44905d8c9bc98. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:37:08.994223 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:37:08.996520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:37:09.139988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-72c27422-a0ae-4e26-93ab-8deae5dcf54e tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.698029 May 10 14:37:09.140963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 763/1419] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:37:08 2022] POST /compute/v2.1/servers => generated 400 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:37:09.159657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4676fd31-fbc4-4036-b696-eef8663323c2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:09.160403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4676fd31-fbc4-4036-b696-eef8663323c2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:09.219370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4676fd31-fbc4-4036-b696-eef8663323c2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:09.226771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4676fd31-fbc4-4036-b696-eef8663323c2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1242 microversion: 2.1 time: 0.079651 May 10 14:37:09.227340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 657/1420] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:09 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:37:10.246465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:10.247078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:10.254620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:10.255072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:10.257454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:10.257454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:10.323041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:10.330553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c756b6de-ea42-4ada-89f6-d556ade9723c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1246 microversion: 2.1 time: 0.089973 May 10 14:37:10.331423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 764/1421] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:10 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:11.348557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:11.349182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:11.355792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:11.356484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:11.357262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:11.357739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:11.425201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:11.430757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3793da77-ffe6-4302-b812-b2c2b5700e4d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1302 microversion: 2.1 time: 0.085961 May 10 14:37:11.432118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 658/1422] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:11 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:12.448997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:12.449571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:12.456483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:12.456927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:12.457714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:12.458149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:12.616178 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:12.624488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20325a95-5f29-4e23-8d75-c6dea427ec50 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.179732 May 10 14:37:12.625070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 765/1423] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:12 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:37:13.134547 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-51027ce5-2e0c-4c45-a3e9-0631933e13be req-f6a118aa-e4da-4b50-9973-0d84ea831579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa87b0b7-2c67-463e-bed9-fba02f1215a8", "tag": "845dd59d-e311-4268-91b8-d95d89e6b945"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:37:13.148104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-51027ce5-2e0c-4c45-a3e9-0631933e13be req-f6a118aa-e4da-4b50-9973-0d84ea831579 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:13.148282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-51027ce5-2e0c-4c45-a3e9-0631933e13be req-f6a118aa-e4da-4b50-9973-0d84ea831579 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:13.166944 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-51027ce5-2e0c-4c45-a3e9-0631933e13be req-f6a118aa-e4da-4b50-9973-0d84ea831579 service nova] Creating event network-changed:845dd59d-e311-4268-91b8-d95d89e6b945 for instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 on hv-cinder-84112 May 10 14:37:13.172756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-51027ce5-2e0c-4c45-a3e9-0631933e13be req-f6a118aa-e4da-4b50-9973-0d84ea831579 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042871 May 10 14:37:13.173581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 659/1424] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:37:13.641373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:13.641979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:13.648510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:13.648958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:13.649778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:13.650484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:13.785417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:13.793873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-db556c66-414f-41e9-96b1-6d0d720c794d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.156350 May 10 14:37:13.794658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 766/1425] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:13 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:14.812285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:14.812988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:14.819661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:14.820107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:14.820881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:14.821319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:14.963138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:14.970809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d7744414-cdcc-45db-893a-a2712c221bc8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.162730 May 10 14:37:14.971389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 660/1426] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:14 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:15.987604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:15.988356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:15.996195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:15.996640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:15.997403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:15.997834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:16.140364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:16.148433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-590a8b41-1ba9-4465-a335-bbd5cf9e4599 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.164627 May 10 14:37:16.149006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 767/1427] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:15 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:17.169226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:17.170175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:17.177643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:17.178098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:17.178913 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:17.179346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:17.325040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:17.332490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d2e8827-745d-481c-b22d-8cc7ad85e34b tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.169931 May 10 14:37:17.333071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 661/1428] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:17 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:18.350601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:18.351638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:18.360313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:18.360768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:18.361784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:18.362318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:18.529818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:18.537225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55a0a69a-bb80-4422-94cf-1035f357fc48 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.190781 May 10 14:37:18.538162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 768/1429] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:18 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:37:19.556066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:19.556798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:19.563316 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:19.563768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:19.564547 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:19.564993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:19.716171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:19.723760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f6c3a8a-966b-45ec-9748-c56967691876 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.172042 May 10 14:37:19.724336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 662/1430] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:19 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:37:20.608314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-23ecc615-31a6-4813-beee-1d3595491056 req-b3052225-84ad-4135-b050-6e134db46124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa87b0b7-2c67-463e-bed9-fba02f1215a8", "name": "network-vif-plugged", "status": "completed", "tag": "845dd59d-e311-4268-91b8-d95d89e6b945"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:37:20.617142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-23ecc615-31a6-4813-beee-1d3595491056 req-b3052225-84ad-4135-b050-6e134db46124 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:20.617808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-23ecc615-31a6-4813-beee-1d3595491056 req-b3052225-84ad-4135-b050-6e134db46124 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:20.628830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-23ecc615-31a6-4813-beee-1d3595491056 req-b3052225-84ad-4135-b050-6e134db46124 service nova] Creating event network-vif-plugged:845dd59d-e311-4268-91b8-d95d89e6b945 for instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 on hv-cinder-84112 May 10 14:37:20.634749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-23ecc615-31a6-4813-beee-1d3595491056 req-b3052225-84ad-4135-b050-6e134db46124 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029969 May 10 14:37:20.635264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 769/1431] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:37:20.741415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:20.742035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:20.749530 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:20.749830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:20.750820 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:20.751264 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:20.893457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:20.905053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32983e09-eb38-44e1-994a-12fe2009c15d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.167612 May 10 14:37:20.905812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 663/1432] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:20 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:21.923157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:21.923856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:21.930671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:21.931172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:21.932109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:21.932551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:22.065834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:22.074870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1deee53c-e525-4eaf-aec2-db0f5ab1cccb tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1366 microversion: 2.1 time: 0.156399 May 10 14:37:22.075444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 770/1433] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:21 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:23.092825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:23.093440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:23.100582 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:23.101033 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:23.101958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:23.102431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:23.249584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:37:23.256695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-51d08e7d-127a-4ed7-a77e-6a90365499e8 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1556 microversion: 2.1 time: 0.167848 May 10 14:37:23.257256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 664/1434] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:37:23 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:37:23.274187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71d55378-252a-4f91-964f-08370ae83fab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:37:23.274888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71d55378-252a-4f91-964f-08370ae83fab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:37:23.281244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71d55378-252a-4f91-964f-08370ae83fab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:23.281710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71d55378-252a-4f91-964f-08370ae83fab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:23.282678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71d55378-252a-4f91-964f-08370ae83fab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:23.282951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71d55378-252a-4f91-964f-08370ae83fab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:23.390887 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71d55378-252a-4f91-964f-08370ae83fab tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120466 May 10 14:37:23.391549 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 771/1435] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 10 14:37:23 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:37:24.525148 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-0c1b6299-a853-413c-8d79-ae6c0ea97f83 req-8fb1e50e-e61d-41ce-91f9-5500e5c7ab9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa87b0b7-2c67-463e-bed9-fba02f1215a8", "tag": "845dd59d-e311-4268-91b8-d95d89e6b945"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:37:24.534317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0c1b6299-a853-413c-8d79-ae6c0ea97f83 req-8fb1e50e-e61d-41ce-91f9-5500e5c7ab9e service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:37:24.534839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0c1b6299-a853-413c-8d79-ae6c0ea97f83 req-8fb1e50e-e61d-41ce-91f9-5500e5c7ab9e service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:37:24.547498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-0c1b6299-a853-413c-8d79-ae6c0ea97f83 req-8fb1e50e-e61d-41ce-91f9-5500e5c7ab9e service nova] Creating event network-changed:845dd59d-e311-4268-91b8-d95d89e6b945 for instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 on hv-cinder-84112 May 10 14:37:24.557711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-0c1b6299-a853-413c-8d79-ae6c0ea97f83 req-8fb1e50e-e61d-41ce-91f9-5500e5c7ab9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036681 May 10 14:37:24.559205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 665/1436] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:38:39.934050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c73201dc-93a3-4bf8-838f-5c34ee279735 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:38:39.934645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c73201dc-93a3-4bf8-838f-5c34ee279735 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:38:39.943848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c73201dc-93a3-4bf8-838f-5c34ee279735 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:38:39.944314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c73201dc-93a3-4bf8-838f-5c34ee279735 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:38:39.945210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c73201dc-93a3-4bf8-838f-5c34ee279735 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:38:39.945774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c73201dc-93a3-4bf8-838f-5c34ee279735 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:38:39.973192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c73201dc-93a3-4bf8-838f-5c34ee279735 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8/ips" status: 200 len: 150 microversion: 2.1 time: 0.102861 May 10 14:38:39.973730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 772/1437] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:38:39 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:41:02.230029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f72e0f51-59d1-4534-b3ec-f971aca26b14] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 14:41:02.234756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:02.235340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:02.242808 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:02.243259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:02.244077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:02.244518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:02.272978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:41:02.552654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31c1f9ab-d684-4914-bb1f-ac6862d6740d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 204 len: 0 microversion: 2.1 time: 0.324293 May 10 14:41:02.554475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 666/1438] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:41:02 2022] DELETE /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:41:02.564515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:02.566039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:02.572649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:02.573101 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:02.573883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:02.574428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:02.708464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:02.716837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9336d94a-d801-486f-a2ab-6d100f9c8121 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157942 May 10 14:41:02.717789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 773/1439] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:02 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:03.437904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5eddb76e-ad97-4629-be0d-6edef8fb095d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] Calling method '.version_select at 0x7fef84595b80>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:03.456778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] [f72e0f51-59d1-4534-b3ec-f971aca26b14] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 37080. May 10 14:41:03.513388 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5eddb76e-ad97-4629-be0d-6edef8fb095d tempest-TestVolumeBootPattern-516031353 tempest-TestVolumeBootPattern-516031353-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1282433387" status: 202 len: 0 microversion: 2.1 time: 0.079640 May 10 14:41:03.513972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 667/1440] 10.222.0.58 () {58 vars in 1262 bytes} [Tue May 10 14:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1282433387 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:41:03.735862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:03.736457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:03.743914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:03.744358 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:03.745312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:03.745741 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:04.197681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:04.205643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dbd7dbd5-941f-40a6-9685-810548be0da6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.473951 May 10 14:41:04.206282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 774/1441] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:03 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:05.224694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:05.226541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:05.235950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:05.236411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:05.237476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:05.237918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:05.497565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:05.505556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-982adfd5-635d-43fd-a105-ec50ea6d2633 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.284911 May 10 14:41:05.506182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 668/1442] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:05 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:06.526258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:06.526870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:06.534247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:06.536846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:06.536846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:06.536846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:07.126162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:07.137371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-940cded1-1322-484f-99f2-40184c2ce7f3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.616070 May 10 14:41:07.137969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 775/1443] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:06 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:08.158335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:08.159612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:08.167197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:08.168019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:08.169341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:08.169955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:08.419855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:08.429106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-210f0f86-6726-4d68-a81f-2c7f7b28cd7f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.276710 May 10 14:41:08.430942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 669/1444] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:08 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:09.447222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:09.448526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:09.455882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:09.456661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:09.457759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:09.458434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:09.679009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:09.687436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-777c73cd-8a36-4ef6-beea-36edf4a3cfde tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.244787 May 10 14:41:09.688776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 776/1445] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:09 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:41:10.709741 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:10.710386 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:10.717029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:10.717613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:10.720023 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:10.720710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:11.108726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:11.127292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a54ad6a-ba95-4289-8599-1c71fed248c0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.426154 May 10 14:41:11.127983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 670/1446] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:10 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:12.145434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:12.146071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:12.153481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:12.153932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:12.154759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:12.155198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:12.332985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:12.341883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-67f5af83-ee40-4111-9644-771fe86f19e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.200405 May 10 14:41:12.342640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 777/1447] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:12 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:13.361427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:13.362118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:13.369331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:13.369780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:13.370685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:13.371192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:13.517942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:13.528928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc5a5b84-504c-40e3-90c7-277a20dcd93c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.172632 May 10 14:41:13.529512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 671/1448] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:13 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:14.547199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:14.547788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:14.554387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:14.554837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:14.555606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:14.556038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:14.683466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:14.691232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bb396a3e-5547-4be6-b8e7-2c85ad55a1c4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148111 May 10 14:41:14.691791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 778/1449] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:14 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:15.708341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:15.708883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:15.716017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:15.716468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:15.717251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:15.717677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:15.846737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:15.854697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ab30be5-3f3d-41e0-b9ca-ab99078ec032 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150382 May 10 14:41:15.855251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 672/1450] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:15 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:16.869836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd9701d5-076f-4d37-ba43-17a347a4bf7d] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 14:41:16.873277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:16.873950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:16.880035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:16.880485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:16.881834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:16.882396 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:17.016810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:17.025419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e12a2cd5-f138-439f-b5c0-61cf337f86b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157068 May 10 14:41:17.025999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 779/1451] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:16 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:41:18.043811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:18.044657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:18.051175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:18.051621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:18.052670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:18.053107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:18.196448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:18.204510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed474dba-0c29-4f9f-9df9-5ea7a19668d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164709 May 10 14:41:18.205111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 673/1452] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:18 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:19.222707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:19.223353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:19.232065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:19.232512 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:19.233289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:19.233987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:19.239258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd9701d5-076f-4d37-ba43-17a347a4bf7d] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 37262. May 10 14:41:19.367719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:19.375499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2eb26516-35d4-4fe7-b546-2a18a758ac2c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156833 May 10 14:41:19.376073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 780/1453] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:19 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:20.397838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:20.398459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:20.405740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:20.406182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:20.406991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:20.407403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:20.538981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:20.546710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f3e459e5-193b-4725-95da-5f4f47ad3514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152763 May 10 14:41:20.547273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 674/1454] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:20 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:21.563714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:21.564462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:21.571253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:21.571740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:21.572592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:21.573067 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:21.877236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:21.885909 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-21940093-09a8-451d-9f96-06c9a7347f89 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.326097 May 10 14:41:21.886499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 781/1455] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:21 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:22.903198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:22.903833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:22.910223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:22.910673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:22.911435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:22.911861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:23.040090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:23.048292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e92271ec-be38-4761-a841-b4f4e805acc5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148941 May 10 14:41:23.048882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 675/1456] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:22 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:24.066233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:24.066990 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:24.074847 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:24.075336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:24.076118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:24.076548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:24.208312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:24.216209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3359a3fe-0b6d-4bb0-be94-f5fbb86944c1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153934 May 10 14:41:24.216796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 782/1457] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:24 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:25.234637 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:25.235455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:25.241794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:25.242269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:25.243059 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:25.243498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:25.374953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:25.383622 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5633dbd-02c5-4856-9ead-cc539879b0c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153206 May 10 14:41:25.384393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 676/1458] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:25 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:26.401161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:26.401759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:26.408003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:26.408449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:26.409204 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:26.409635 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:26.543948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:26.551824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6aa4572-f0d2-4814-b784-6558b8f06b74 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155025 May 10 14:41:26.552384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 783/1459] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:26 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:27.569793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:27.570427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:27.576982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:27.577449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:27.578252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:27.578715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:27.709694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:27.717596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d68286b4-f36d-4061-ac05-369b325a0861 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152332 May 10 14:41:27.718164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 677/1460] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:27 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:28.735004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:28.735640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:28.743172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:28.743619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:28.744382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:28.744814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:28.878712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:28.892114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0ec8f19b-5393-4af1-8701-e69b1596c800 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161173 May 10 14:41:28.892698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 784/1461] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:28 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:29.908805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:29.909421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:29.916849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:29.917310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:29.918088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:29.918730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:30.048815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:30.057171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b14c3910-087f-4677-81f9-286c3f72ab13 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152324 May 10 14:41:30.057736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 678/1462] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:29 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:31.075231 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:31.075865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:31.082325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:31.082773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:31.083539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:31.083969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:31.223513 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:31.232158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f3dfac10-e9ab-4cb2-a887-29bfe0218ac5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160612 May 10 14:41:31.232728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 785/1463] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:31 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:32.249621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:32.250226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:32.257068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:32.257515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:32.258329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:32.258768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:32.407863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:32.416263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b1657eb-9b8a-4c0f-9fa1-ae26fd585b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.170538 May 10 14:41:32.416848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 679/1464] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:32 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:33.433499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:33.434113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:33.440441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:33.440913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:33.441687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:33.442122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:33.580489 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:33.590920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c50c56e-a64e-4f19-bdb3-b186fac3a6b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160838 May 10 14:41:33.591824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 786/1465] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:33 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:34.609367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:34.609979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:34.616719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:34.618807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:34.618807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:34.618807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:34.756933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:34.765069 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2e15a88-d6bf-407e-beb0-f3e933c3b3de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159932 May 10 14:41:34.765692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 680/1466] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:34 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:41:35.783203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:35.783813 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:35.791211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:35.791661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:35.792433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:35.792861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:35.923295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:35.931173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1b5addf6-bd2a-4340-8e95-688f07b05a7d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152045 May 10 14:41:35.931718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 787/1467] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:35 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:36.949250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:36.949939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:36.956367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:36.956806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:36.957649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:36.958077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:37.090674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:37.098771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a89d9070-7830-48c5-8193-de94ef46585d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153670 May 10 14:41:37.099339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 681/1468] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:36 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:38.117955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:38.118551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:38.124728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:38.125176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:38.125938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:38.126419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:38.260937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:38.268783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-acdff46f-7117-41af-8337-4e192e8c6b93 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155677 May 10 14:41:38.269343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 788/1469] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:38 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:39.285085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:39.285701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:39.292311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:39.292764 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:39.293538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:39.293978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:39.426258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:39.434416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a43cffc-34ab-42b0-b489-b69a2c7cf894 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153241 May 10 14:41:39.434976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 682/1470] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:39 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:40.452155 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:40.452792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:40.460102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:40.460580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:40.461346 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:40.461781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:40.589096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:40.596914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a02fba61-d4cc-4db8-bad0-32c177f56873 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148566 May 10 14:41:40.597479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 789/1471] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:40 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:41.614671 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:41.615697 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:41.621989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:41.622467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:41.623229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:41.623657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:41.761796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:41.769645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ce6b231-d778-475e-b1ea-dd28ae833beb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.158861 May 10 14:41:41.770225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 683/1472] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:41 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:42.788595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:42.789292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:42.795707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:42.796159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:42.797163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:42.797604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:42.924021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:42.931910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2f8c7764-d524-43ef-a636-a6b556ed0be5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.147779 May 10 14:41:42.932515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 790/1473] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:42 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:43.949017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:43.949622 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:43.955941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:43.956387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:43.957142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:43.957570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:44.089742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:44.097693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e9460f1-fd47-46f4-b55f-7e7971147056 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152566 May 10 14:41:44.098273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 684/1474] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:43 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:45.116420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:45.116979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:45.123337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:45.123941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:45.124715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:45.125153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:45.254888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:45.263280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa18efaf-f6de-4a14-9ca3-3ef45f8bc7a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151353 May 10 14:41:45.264165 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 791/1475] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:45 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:46.280706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:46.281316 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:46.287642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:46.288163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:46.288940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:46.289550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:46.417616 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:46.425568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7d56f2c-723a-4cda-b954-af4c09ff2b44 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148654 May 10 14:41:46.426141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 685/1476] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:46 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:47.443963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:47.444657 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:47.451357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:47.451795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:47.452565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:47.453003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:47.579772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:47.588332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e1553e3c-de90-484e-8523-48a06a8e55ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148781 May 10 14:41:47.588896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 792/1477] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:47 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:41:48.605896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:48.606536 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:48.613146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:48.613588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:48.614380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:48.614818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:48.751371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:48.755027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4292bdba-cad5-4f7b-b7e5-8f4d910d0482 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153139 May 10 14:41:48.755653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 686/1478] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:48 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:41:49.772802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:49.773449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:49.779532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:49.779971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:49.780769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:49.781207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:49.914716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:49.922534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fc431af6-f38d-49ad-a588-45ad99b1c5e6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154087 May 10 14:41:49.923105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 793/1479] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:49 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:50.940259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:50.940871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:50.947332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:50.947785 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:50.948559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:50.948994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:51.078714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:51.087133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e4be750-45a0-43eb-b56b-434ac97c7c50 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150654 May 10 14:41:51.087598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 687/1480] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:50 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:52.103964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:52.104579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:52.111245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:52.111690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:52.112450 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:52.112884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:52.248181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:52.256536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6c75967f-f2bd-4600-b9e5-baf658d00418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156398 May 10 14:41:52.257164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 794/1481] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:52 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:53.273910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:53.274615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:53.281037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:53.281481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:53.282277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:53.282796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:53.416527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:53.424423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-721c7c6f-ce18-4551-969e-449937e34da2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154903 May 10 14:41:53.424994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 688/1482] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:53 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:54.441134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:54.441688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:54.448755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:54.449203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:54.449977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:54.450444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:54.577916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:54.586725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8cb705d7-cc47-42ba-9f74-57452cdbf5ad tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149701 May 10 14:41:54.587280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 795/1483] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:54 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:55.604409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:55.605049 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:55.611657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:55.612116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:55.612879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:55.613313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:55.746865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:55.754781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc8324e6-dda1-4c13-8c3d-49674e9b6c30 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154296 May 10 14:41:55.755343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 689/1484] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:55 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:41:56.773238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:56.773852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:56.780528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:56.781199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:56.781978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:56.782445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:56.918520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:56.926868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fae4a735-1e2f-4213-b742-5ad61342926c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.158770 May 10 14:41:56.927950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 796/1485] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:56 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:57.945965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:57.946611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:57.953167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:57.953621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:57.954438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:57.954877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:58.090796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:58.098797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c367bfee-1f60-4e8e-989a-93583c89efd0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157425 May 10 14:41:58.099722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 690/1486] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:57 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:41:59.116386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:41:59.116981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:41:59.123271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:59.123791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:59.124479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:41:59.124915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:41:59.266709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:41:59.275289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a63146aa-0e07-4e47-befd-b4f54a38ec91 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.162933 May 10 14:41:59.275860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 797/1487] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:41:59 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:00.293195 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:00.293815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:00.300154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:00.300607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:00.301382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:00.301815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:00.613658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:00.621694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c90f7ad3-3f95-42ce-89a5-f0e92d7ae654 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.332409 May 10 14:42:00.622287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 691/1488] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:00 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:01.640091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:01.640728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:01.647075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:01.647542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:01.648304 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:01.648742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:01.834011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:01.841805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9252e050-7a9c-4a4b-94f7-fe1d27b2da98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.205613 May 10 14:42:01.842408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 798/1489] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:01 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:02.859964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:02.860518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:02.867434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:02.867884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:02.868663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:02.869098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:02.998969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:03.008065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed4551fe-52e5-4099-855e-712403a1b6dd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152310 May 10 14:42:03.008634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 692/1490] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:02 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:04.025807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:04.026573 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:04.033049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:04.033504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:04.034312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:04.034754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:04.165761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:04.173576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d1143dbe-6f23-4007-96fe-ccdb3f6d6346 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151661 May 10 14:42:04.174138 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 799/1491] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:04 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:05.191590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:05.192209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:05.198611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:05.199059 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:05.199862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:05.200295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:05.329045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:05.337768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06b37bfb-1eb5-46dd-81d8-5dfe06867613 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150170 May 10 14:42:05.338382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 693/1492] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:05 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:06.355735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:06.356344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:06.362984 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:06.363439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:06.364209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:06.365279 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:06.499798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:06.515431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d53ba18a-315b-4c3a-8708-4df3dd9ca5ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.162584 May 10 14:42:06.515431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 800/1493] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:06 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:07.533443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:07.534374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:07.540805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:07.541257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:07.542121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:07.542592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:07.707113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:07.715643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-caab3f18-ce72-486a-9941-98c171c0fbe2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.186414 May 10 14:42:07.716480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 694/1494] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:07 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:08.734542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:08.735409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:08.742726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:08.743186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:08.743979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:08.744422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:08.881455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:08.890822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-324cb525-6647-44be-8474-a5bf1d1bf491 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160148 May 10 14:42:08.891393 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 801/1495] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:08 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:09.908477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:09.909082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:09.915488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:09.916418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:09.917192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:09.917626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:10.051107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:10.060296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2434997-f46e-4f55-ba8b-28b7e6cdb61a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155658 May 10 14:42:10.060863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 695/1496] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:09 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:11.077972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:11.078641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:11.085073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:11.085518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:11.086307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:11.086744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:11.216732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:11.225120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01290cdf-109e-427f-85e1-e24d07434560 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151111 May 10 14:42:11.225681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 802/1497] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:11 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:12.242541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:12.243114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:12.249584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:12.250033 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:12.250831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:12.251268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:12.388199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:12.398034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9e359e9-28de-497e-8a52-46efdd19b7a6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159645 May 10 14:42:12.398633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 696/1498] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:12 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:13.416267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:13.417615 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:13.427517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:13.428228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:13.429430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:13.430066 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:13.567889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:13.575963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-890a0c8b-e3dd-4595-98e4-301ccf213914 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164336 May 10 14:42:13.576542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 803/1499] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:13 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:14.593518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:14.594166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:14.600852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:14.601295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:14.602077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:14.602544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:14.733563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:14.741817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50364e4a-ca3b-4e17-82df-f60fa203cd01 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152164 May 10 14:42:14.742433 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 697/1500] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:14 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:42:15.758964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:15.759582 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:15.766071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:15.766556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:15.767327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:15.767769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:15.893982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:15.902804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-62e04ccf-33ea-4f73-aefe-c712051c2628 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.147664 May 10 14:42:15.903394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 804/1501] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:15 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:42:16.924405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:16.925038 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:16.932250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:16.932762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:16.933551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:16.933992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:17.063221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:17.072001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-48fa16b8-dc67-4766-a6a9-6a516e07b9ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151479 May 10 14:42:17.075665 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 698/1502] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:16 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:18.090888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:18.091513 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:18.101449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:18.101906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:18.102726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:18.103172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:18.235804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:18.243869 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7978f101-04f8-4cdb-ad8e-0b80486baaf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156884 May 10 14:42:18.244475 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 805/1503] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:18 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:19.261602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:19.262400 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:19.269151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:19.269603 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:19.270996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:19.271432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:19.404390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:19.412790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39bf74a0-2389-40ba-8bf5-d53b75d7d936 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155092 May 10 14:42:19.413382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 699/1504] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:19 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:20.431404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:20.432019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:20.438118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:20.438594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:20.439361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:20.439797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:20.572951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:20.582139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2a4cd529-42f4-45ae-bcd2-cc5e7a492451 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155163 May 10 14:42:20.582971 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 806/1505] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:20 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:21.600566 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:21.601180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:21.608501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:21.608947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:21.609729 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:21.610462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:21.759331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:21.767459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d878505c-92d1-49ad-bca7-ff3cd6f19354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.171286 May 10 14:42:21.768034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 700/1506] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:21 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:22.786695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:22.787412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:22.794580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:22.795037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:22.795818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:22.796261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:22.936547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:22.945565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-92e7e7b5-5fb5-4926-b4cf-d54de2697475 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.163981 May 10 14:42:22.946131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 807/1507] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:22 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:23.965845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:23.966618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:23.973057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:23.974275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:23.975175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:23.975608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:24.105677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:24.114548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f401a768-e43d-4a9a-9265-3a13c6c25efe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153795 May 10 14:42:24.115180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 701/1508] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:23 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:25.134101 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:25.134764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:25.141137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:25.141597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:25.142416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:25.142862 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:25.271324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:25.279243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c0e6fdb-692f-4725-a795-da612d716b9f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149055 May 10 14:42:25.279801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 808/1509] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:25 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:26.297005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:26.297880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:26.304769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:26.305218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:26.305995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:26.306544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:26.443270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:26.452179 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4096ed22-a9ed-4e07-87d0-59b415c1cf32 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159052 May 10 14:42:26.452867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 702/1510] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:26 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:27.470790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:27.471417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:27.479028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:27.479481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:27.480256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:27.480686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:27.611600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:27.619487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d94b520d-1f1a-48ed-be2f-0ffd4bf0610a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152851 May 10 14:42:27.620065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 809/1511] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:27 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:28.636715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:28.637283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:28.643857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:28.644325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:28.645698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:28.646136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:28.784208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:28.792876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb5a4714-fb28-4e0f-814f-1138b5b5dc02 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160093 May 10 14:42:28.793457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 703/1512] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:28 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:29.811882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:29.812746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:29.819016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:29.819477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:29.820278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:29.820725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:29.954084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:29.963235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dffcdf2f-db28-49ca-b112-f4c899babd46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155860 May 10 14:42:29.963832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 810/1513] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:29 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:30.980840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:30.981450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:30.988176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:30.988638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:30.989445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:30.989924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:31.132289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:31.140340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c712fc2-03ae-47eb-a577-6a442e03a0ee tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.163487 May 10 14:42:31.140921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 704/1514] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:30 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:32.158708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:32.159326 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:32.166409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:32.166869 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:32.167645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:32.168083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:32.304463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:32.312535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-85cd34ce-bd65-4191-80d1-378ded7f13fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157805 May 10 14:42:32.313041 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 811/1515] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:32 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:33.331201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:33.331781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:33.338880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:33.339326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:33.340097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:33.340531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:33.469012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:33.476844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22d0576f-a42f-4827-9de0-b257a0075b71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149745 May 10 14:42:33.477405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 705/1516] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:33 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:34.494837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:34.495441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:34.501736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:34.502182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:34.502970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:34.503403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:34.637740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:34.646409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-11002c7d-bd22-4ff6-b479-7392dfb879c7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155347 May 10 14:42:34.646994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 812/1517] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:34 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:35.669162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:35.669162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:35.671371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:35.671824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:35.672594 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:35.673030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:35.811606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:35.819865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47b0dab7-f5aa-45b0-8589-38ccda08cbf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159939 May 10 14:42:35.820447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 706/1518] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:35 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:36.837065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:36.837679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:36.844146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:36.844597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:36.845362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:36.845790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:36.978653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:36.986770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-19bdab34-c0ff-4e1e-8520-0874bfb61169 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153526 May 10 14:42:36.987336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 813/1519] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:36 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:38.004597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:38.005354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:38.011699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:38.012149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:38.012972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:38.013403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:38.145983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:38.154115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-616a24d7-f429-4778-a890-dcf5952ad37f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153356 May 10 14:42:38.154720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 707/1520] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:37 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:39.172636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:39.173298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:39.180562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:39.181008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:39.181813 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:39.182273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:39.312485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:39.320342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6ad0a254-fc6c-4adb-886b-521e8d5e419e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151703 May 10 14:42:39.320913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 814/1521] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:39 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:40.337303 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:40.337951 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:40.344321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:40.344774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:40.345549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:40.345987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:40.479953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:40.488197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4eba209-f08f-4149-92ec-937a0177ecb7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154748 May 10 14:42:40.489501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 708/1522] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:40 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:41.507283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:41.507893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:41.514316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:41.514768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:41.515543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:41.516017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:41.651189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:41.659058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c5e16e99-119f-42da-8d37-450b85cecabb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156843 May 10 14:42:41.659618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 815/1523] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:41 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:42.676492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:42.677040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:42.683398 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:42.688549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:42.688549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:42.688549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:42.814690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:42.822545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3a58530c-5b39-466f-b9e5-ac1b532ea10e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149964 May 10 14:42:42.823110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 709/1524] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:42 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:43.492874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:43.493416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:43.499828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:43.500272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:43.501040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:43.501471 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:43.528605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:42:43.840017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:43.840653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:43.848679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:43.849138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:43.849941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:43.850408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:43.976088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5a601b52-bbf7-4f0b-9882-b940b8d548a9 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 204 len: 0 microversion: 2.20 time: 0.487729 May 10 14:42:43.976633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 816/1525] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 10 14:42:43 2022] DELETE /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:42:43.978679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:43.985690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:43.986416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:43.987304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00698d2a-2ca0-4834-b0cc-cecefc628a1e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151183 May 10 14:42:43.988936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 710/1526] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:43 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:43.995458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:43.999242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:43.999242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:43.999242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:44.132646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:44.140962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:44.142490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:44.143666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7bcdf6cc-853e-4493-a442-6188e9baa632 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1721 microversion: 2.20 time: 0.162573 May 10 14:42:44.144981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 817/1527] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:42:43 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:42:45.004943 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:45.005614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:45.012361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:45.012813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:45.013591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:45.014080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:45.148383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:45.156292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4191c37f-2fc7-4b3e-b54e-761162b4a3b5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155325 May 10 14:42:45.157039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 711/1528] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:44 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:45.163122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:45.163964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:45.170502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:45.170961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:45.171755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:45.172191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:45.327075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:45.337710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:45.339253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:45.340526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5348d1c-2456-43f7-932d-870368980dde tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1721 microversion: 2.20 time: 0.182086 May 10 14:42:45.354443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 818/1529] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:42:45 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:42:46.170009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-591113cc-fb7d-4abf-82f9-50b9a285094b req-271b1e18-b42a-4e1e-a919-7c073185f041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49da3bbb-c3f4-4beb-8c62-d2a44c42d23f", "name": "network-vif-deleted", "tag": "b1212718-e07e-4853-ae17-f09246be6825"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:42:46.180692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-591113cc-fb7d-4abf-82f9-50b9a285094b req-271b1e18-b42a-4e1e-a919-7c073185f041 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:46.181135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-591113cc-fb7d-4abf-82f9-50b9a285094b req-271b1e18-b42a-4e1e-a919-7c073185f041 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:46.182932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:46.183915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:46.195351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:46.195813 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:46.196608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:46.196852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-591113cc-fb7d-4abf-82f9-50b9a285094b req-271b1e18-b42a-4e1e-a919-7c073185f041 service nova] Creating event network-vif-deleted:b1212718-e07e-4853-ae17-f09246be6825 for instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f on hv-cinder-84112 May 10 14:42:46.197048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:46.202344 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-591113cc-fb7d-4abf-82f9-50b9a285094b req-271b1e18-b42a-4e1e-a919-7c073185f041 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097264 May 10 14:42:46.203208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 712/1530] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:42:46.358583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:46.361225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:46.362953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:46.371294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5a522a4b-3007-405f-831a-e960d3ba1f83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.200763 May 10 14:42:46.372346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:46.373097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:46.374128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:46.374794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:46.380070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 819/1531] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:46 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:42:46.448391 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:46.457181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:46.458719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dae4d7a57f343c8bb7b92dbebea181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549d2b7b890411f878fe6fe776e65d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:46.459877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0aa9f647-4358-4ef9-9aa5-1c0da3264dd3 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 200 len: 1365 microversion: 2.20 time: 0.103792 May 10 14:42:46.460675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 713/1532] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:42:46 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:42:47.390759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:47.391404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:47.399035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:47.399484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:47.400260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:47.400695 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:47.478423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:47.479199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:47.487062 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:47.487649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:47.489736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:47.490324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:47.506804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f HTTP/1.1 May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:42:47.508514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:42:47.510271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '49da3bbb-c3f4-4beb-8c62-d2a44c42d23f'} May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:42:47.511184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:42:47.512716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:42:47.515272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:42:47.515272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7b245b0-ec94-46a0-bc07-9d944b12fe77 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 404 len: 111 microversion: 2.20 time: 0.035685 May 10 14:42:47.515272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 714/1533] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:42:47 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:42:47.519346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4612815-01f0-437a-8256-421d70a92917 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '.version_select at 0x7fef895f7a60>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:47.539493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:47.548103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9fd181ad-a496-4a7c-b194-cafc50181c51 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161370 May 10 14:42:47.549334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 820/1534] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:47 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:47.611244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4612815-01f0-437a-8256-421d70a92917 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332434994" status: 204 len: 0 microversion: 2.20 time: 0.095770 May 10 14:42:47.611746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 715/1535] 10.222.0.58 () {60 vars in 1258 bytes} [Tue May 10 14:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332434994 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 14:42:48.570236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:48.570889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:48.577772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:48.578331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:48.579128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:48.579592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:48.722042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:48.731083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e870a04-1639-4962-8190-087b27b5720a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.165054 May 10 14:42:48.731703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 821/1536] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:48 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:42:49.749800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:49.750464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:49.758050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:49.758535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:49.759324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:49.759764 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:49.901813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:49.910256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9a9dc56-05f5-4b8b-b4ca-de9b5eeca01e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164687 May 10 14:42:49.910877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 716/1537] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:49 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:50.927879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:50.928581 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:50.935036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:50.935491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:50.936287 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:50.936730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:51.081082 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:51.090421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46cc034f-3d2c-4c5c-9d73-2689fa7d7d84 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.167023 May 10 14:42:51.091318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 822/1538] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:50 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:52.108013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:52.108638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:52.115835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:52.116295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:52.117093 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:52.117533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:52.257314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:52.266930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-589022d4-98e2-4655-a05f-5061404032ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.162983 May 10 14:42:52.267583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 717/1539] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:52 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:53.285948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:53.286595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:53.292973 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:53.293435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:53.294227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:53.294684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:53.434140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:53.443460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-03b57609-3e4c-4bd4-91d4-1889161d4bb5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161350 May 10 14:42:53.444055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 823/1540] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:53 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:54.464176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:54.464779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:54.471368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:54.471810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:54.472807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:54.473240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:54.611515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:54.623614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d8b9c6c4-5eb8-4f41-8963-7b38a962cff2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.166689 May 10 14:42:54.624312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 718/1541] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:54 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:55.642430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:55.643158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:55.650677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:55.651133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:55.651934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:55.652364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:55.805516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:55.813327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e41398ad-5c44-4647-b573-95eb35696d48 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.174951 May 10 14:42:55.813889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 824/1542] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:55 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:56.832948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:56.833664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:56.840204 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:56.840655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:56.841434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:56.841871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:56.981162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:56.990373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6037ef4a-dc07-498f-8f27-a22be6b7dca6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161926 May 10 14:42:56.991020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 719/1543] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:56 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:58.010667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:58.011230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:58.017494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:58.017954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:58.018752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:58.019714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:58.156966 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:58.165692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f6a3c164-eb67-4488-afbb-d2b9d53b3150 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160853 May 10 14:42:58.166290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 825/1544] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:58 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:42:59.183213 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:42:59.183963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:42:59.190546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:59.191115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:59.192443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:42:59.192873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:42:59.332244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:42:59.341324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a6baafe-19d1-4ac8-844f-b9b4df96baa8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161981 May 10 14:42:59.341889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 720/1545] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:42:59 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:00.083544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:00.084098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:00.090453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.090903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.091710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.092149 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.117721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:43:00.359361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:00.359988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:00.367291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.367745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.368527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.368967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.506260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:00.514440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f250d6d4-797a-484f-8665-0ea9685a3619 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159036 May 10 14:43:00.515851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 721/1546] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:00 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:00.601296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:00.601784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:00.608016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.608472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.609235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.609750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.621419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-64c97647-f988-403b-97c1-a381fa473433 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 204 len: 0 microversion: 2.1 time: 0.542191 May 10 14:43:00.622108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 826/1547] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:43:00 2022] DELETE /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:43:00.634595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:00.634595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:00.635626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:43:00.638585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.639037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.639859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:00.640382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:00.785417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:00.794504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c60d2ab-25e0-4954-9671-9c17778e7a08 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1506 microversion: 2.1 time: 0.167764 May 10 14:43:00.795207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 827/1548] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:00 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:01.004219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29169867-4feb-4e73-b009-ab0318010337 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 204 len: 0 microversion: 2.1 time: 0.406710 May 10 14:43:01.004936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 722/1549] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:43:00 2022] DELETE /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:43:01.021539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:01.022169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:01.028451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:01.028904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:01.029666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:01.030096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:01.159203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:01.168356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa667805-c8d8-4d4b-96a0-f7f7ce5469ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1718 microversion: 2.1 time: 0.150646 May 10 14:43:01.168934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 828/1550] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:01.652824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:01.653528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:01.659804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:01.660263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:01.661110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:01.661488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:01.801296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:01.810390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-793d164c-29b8-4dcf-9e64-f5c97ef55990 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.278693 May 10 14:43:01.810985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 723/1551] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:01 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:01.946800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:01.947401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:01.953777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:01.954246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:01.955027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:01.955461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:02.086463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:02.095165 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5de5b9f8-f52c-41d4-9fbe-4d5187dbe300 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1506 microversion: 2.1 time: 0.286247 May 10 14:43:02.095965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 829/1552] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:01 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:02.303185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:02.303512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:02.311627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:02.312000 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:02.312923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:02.313439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:02.713217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-9381a41b-45ea-4fe5-a572-4001f73c3f7e req-f53d32dc-99fb-49a8-a7c8-4c42f774dc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6950e83e-172a-43ac-b65a-de78e96476c0", "name": "network-vif-deleted", "tag": "204a47a7-411c-486e-9b83-e27124ec96b4"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:43:02.721747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9381a41b-45ea-4fe5-a572-4001f73c3f7e req-f53d32dc-99fb-49a8-a7c8-4c42f774dc83 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:02.722256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9381a41b-45ea-4fe5-a572-4001f73c3f7e req-f53d32dc-99fb-49a8-a7c8-4c42f774dc83 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:02.735893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-9381a41b-45ea-4fe5-a572-4001f73c3f7e req-f53d32dc-99fb-49a8-a7c8-4c42f774dc83 service nova] Creating event network-vif-deleted:204a47a7-411c-486e-9b83-e27124ec96b4 for instance 6950e83e-172a-43ac-b65a-de78e96476c0 on hv-cinder-84112 May 10 14:43:02.742242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-9381a41b-45ea-4fe5-a572-4001f73c3f7e req-f53d32dc-99fb-49a8-a7c8-4c42f774dc83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032656 May 10 14:43:02.744933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 830/1553] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:43:02.828807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:02.829654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:02.834970 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:02.838925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:02.839656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:02.843336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37d43f7a-fb96-4446-b4d8-f9299ed37e1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1718 microversion: 2.1 time: 0.660741 May 10 14:43:02.844281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:02.844416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 724/1554] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1718 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:02.845162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:03.115744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:03.118885 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:03.133498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:03.136768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:03.137507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:03.138595 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:03.139952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:03.155905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1b46f911-3f80-46b1-91bf-9b0edd587097 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.331126 May 10 14:43:03.157489 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 831/1555] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:02 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:03.185328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:03.185776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:03.186242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lazy-loading 'fault' on Instance uuid 6950e83e-172a-43ac-b65a-de78e96476c0 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:43:03.248054 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:03.256471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61f9ed09-2fa5-4601-bf64-24233aa0f0a7 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 200 len: 1310 microversion: 2.1 time: 0.147639 May 10 14:43:03.257054 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 725/1556] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:03 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 1310 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:03.830368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-43df53fb-7bd3-4c56-bba9-d5897f82f88d req-a5c61a4f-a1f5-499f-a0bb-066675fda2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9825c2a-925f-439c-835d-00b5aade9041", "name": "network-vif-deleted", "tag": "180675a4-4ac8-4200-88cf-1263e04176e0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:43:03.840026 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-43df53fb-7bd3-4c56-bba9-d5897f82f88d req-a5c61a4f-a1f5-499f-a0bb-066675fda2ff service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:03.840478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-43df53fb-7bd3-4c56-bba9-d5897f82f88d req-a5c61a4f-a1f5-499f-a0bb-066675fda2ff service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:03.853877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-43df53fb-7bd3-4c56-bba9-d5897f82f88d req-a5c61a4f-a1f5-499f-a0bb-066675fda2ff service nova] Creating event network-vif-deleted:180675a4-4ac8-4200-88cf-1263e04176e0 for instance f9825c2a-925f-439c-835d-00b5aade9041 on hv-cinder-84112 May 10 14:43:03.862394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-43df53fb-7bd3-4c56-bba9-d5897f82f88d req-a5c61a4f-a1f5-499f-a0bb-066675fda2ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118016 May 10 14:43:03.863367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 832/1557] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:43:03.865858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:03.867124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:03.874711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:03.875427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:03.876441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:03.877063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:03.958264 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:03.967073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4652e1dc-dfb5-42a2-84e4-00eb20a66e89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1650 microversion: 2.1 time: 0.108469 May 10 14:43:03.967663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 726/1558] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:04.178927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:04.179643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:04.185923 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.186419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.187207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.187647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.273219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:04.274100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 6950e83e-172a-43ac-b65a-de78e96476c0] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:04.280676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.281132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.281911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.282527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.297591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] HTTP exception thrown: Instance 6950e83e-172a-43ac-b65a-de78e96476c0 could not be found. May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Request method failure captured: May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 HTTP/1.1 May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPMqt8nEpdvfNrB-sXwTr0irXFMStdPkuBn7pYfF7tMdf2nAJuVnijPn12slEXDjzVetdWYlf5FTDKFih0lrzaS9pW3RmrkLU0SCgCwNdPyrBv7MnMrgMAyMwjiCP7S2ht8V5CY8FzEbQduLLW_GZCgk_G7dkMba2XOcYCe2sPSPf4 May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:43:04.299358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8a7f6dc00b5487b9c323783ef5aaa2b"}]}] May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 5e3edc87e7014d8598ba8c9517b81cf7 May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 6950e83e-172a-43ac-b65a-de78e96476c0 could not be found. May 10 14:43:04.301683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '6950e83e-172a-43ac-b65a-de78e96476c0'} May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6950e83e-172a-43ac-b65a-de78e96476c0 could not be found. May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:43:04.302849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6950e83e-172a-43ac-b65a-de78e96476c0 could not be found. May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6950e83e-172a-43ac-b65a-de78e96476c0 could not be found. May 10 14:43:04.305356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:43:04.307805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Returning 404 to user: Instance 6950e83e-172a-43ac-b65a-de78e96476c0 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:43:04.307805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03ff0c82-6265-4d81-9e1a-ee8e6f9aca5b tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0" status: 404 len: 111 microversion: 2.1 time: 0.032374 May 10 14:43:04.307805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 727/1559] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:04 2022] GET /compute/v2.1/servers/6950e83e-172a-43ac-b65a-de78e96476c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:43:04.309625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:04.310122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:04.316443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.316890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.317669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.318099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.342264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:04.344815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:43:04.351628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-004875b5-9fcf-47fb-9603-93ea6539a51a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.179695 May 10 14:43:04.352211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 833/1560] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:04 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:04.666818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-846bfcff-a4c7-461c-8531-92a6494858c8 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 204 len: 0 microversion: 2.1 time: 0.360425 May 10 14:43:04.667418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 728/1561] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:43:04 2022] DELETE /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:43:04.675917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:04.676644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:04.682839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.683294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.684102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.684541 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.838525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:04.848463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-521edf0e-3d7c-4f87-94c2-d6f853bac3ca tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.175438 May 10 14:43:04.849348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 834/1562] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:04 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:04.984583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:04.985288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:04.992500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.992941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:04.993542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:04.993978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:05.061003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:05.069995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd54baf9-97c4-4eee-a00b-d505a0fdc714 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089615 May 10 14:43:05.070732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 729/1563] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:05.369818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:05.370358 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:05.376749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:05.377192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:05.377989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:05.378508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:05.519404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:05.527341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-447f6c40-10a9-4592-8ab5-3e24928592de tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161552 May 10 14:43:05.527960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 835/1564] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:05 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:05.868531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:05.869147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:05.876158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:05.877089 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:05.877953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:05.879203 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:06.087787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:06.088515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:06.094762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:06.095221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:06.096011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:06.096452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:06.111601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:06.119424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4fe38623-d4c8-43ae-99d5-92f9bfbc7bd9 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1522 microversion: 2.1 time: 0.256737 May 10 14:43:06.120096 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 730/1565] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:05 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:06.172260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:06.181425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ac6c28d8-9557-421b-b3a6-bbc93aadf9e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.097465 May 10 14:43:06.182005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 836/1566] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:06.522679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-e4723799-78a4-470c-b783-794dc0534de3 req-ed609398-a78c-4e62-afc3-1df36db7346e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8bc09f-ec85-4865-93b7-28628f5b8797", "name": "network-vif-deleted", "tag": "c26e2828-6b17-4743-bbb3-84d8dc58732a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:43:06.530978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e4723799-78a4-470c-b783-794dc0534de3 req-ed609398-a78c-4e62-afc3-1df36db7346e service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:06.531521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e4723799-78a4-470c-b783-794dc0534de3 req-ed609398-a78c-4e62-afc3-1df36db7346e service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:06.543423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-e4723799-78a4-470c-b783-794dc0534de3 req-ed609398-a78c-4e62-afc3-1df36db7346e service nova] Creating event network-vif-deleted:c26e2828-6b17-4743-bbb3-84d8dc58732a for instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 on hv-cinder-84112 May 10 14:43:06.544804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:06.545440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:06.549181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-e4723799-78a4-470c-b783-794dc0534de3 req-ed609398-a78c-4e62-afc3-1df36db7346e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 May 10 14:43:06.549798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 731/1567] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:43:06.553694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:06.553814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:06.554601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:06.555045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:06.704419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:06.712886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ad156a8d-d3e6-400d-9163-5f36341bb418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.171875 May 10 14:43:06.713455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 837/1568] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:06 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:07.137220 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:07.137947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:07.145098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:07.145551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:07.146434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:07.146860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:07.178970 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:07.179418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:07.179865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lazy-loading 'fault' on Instance uuid 0a8bc09f-ec85-4865-93b7-28628f5b8797 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:43:07.198456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:07.199159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:07.205175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:07.205867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:07.207681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:07.208092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:07.223025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3edc87e7014d8598ba8c9517b81cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a7f6dc00b5487b9c323783ef5aaa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:07.235304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8536188d-35e0-4a46-b7c2-1270ff248799 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 200 len: 1311 microversion: 2.1 time: 0.101969 May 10 14:43:07.237115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 732/1569] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:07 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:07.291877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:07.301297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e34994f-b9f3-4d81-ae44-a1492baa7a19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.106756 May 10 14:43:07.301872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 838/1570] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:07.731905 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:07.732772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:07.740305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:07.740811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:07.741648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:07.742095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:07.879786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:07.887748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7203f504-7f47-41fb-9e89-2f91874e4b08 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160429 May 10 14:43:07.888316 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 733/1571] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:07 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:08.255296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:08.255915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] [instance: 0a8bc09f-ec85-4865-93b7-28628f5b8797] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:08.262572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:08.263023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:08.263872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:08.264357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:08.277901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] HTTP exception thrown: Instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 could not be found. May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Request method failure captured: May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 HTTP/1.1 May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPMqt8nEpdvfNrB-sXwTr0irXFMStdPkuBn7pYfF7tMdf2nAJuVnijPn12slEXDjzVetdWYlf5FTDKFih0lrzaS9pW3RmrkLU0SCgCwNdPyrBv7MnMrgMAyMwjiCP7S2ht8V5CY8FzEbQduLLW_GZCgk_G7dkMba2XOcYCe2sPSPf4 May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:43:08.279625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a7f6dc00b5487b9c323783ef5aaa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8a7f6dc00b5487b9c323783ef5aaa2b"}]}] May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: b8a7f6dc00b5487b9c323783ef5aaa2b May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-15247582 May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 5e3edc87e7014d8598ba8c9517b81cf7 May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-ServerRescueNegativeTestJSON-15247582-project May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 could not be found. May 10 14:43:08.281376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '0a8bc09f-ec85-4865-93b7-28628f5b8797'} May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 could not be found. May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:43:08.282416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 could not be found. May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 could not be found. May 10 14:43:08.284132 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:43:08.285812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] Returning 404 to user: Instance 0a8bc09f-ec85-4865-93b7-28628f5b8797 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:43:08.285812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5b2263b2-b40f-4238-9241-28a8cadb8205 tempest-ServerRescueNegativeTestJSON-15247582 tempest-ServerRescueNegativeTestJSON-15247582-project] 10.222.0.58 "GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797" status: 404 len: 111 microversion: 2.1 time: 0.030323 May 10 14:43:08.285812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 839/1572] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:08 2022] GET /compute/v2.1/servers/0a8bc09f-ec85-4865-93b7-28628f5b8797 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:43:08.320856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:08.321570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:08.328418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:08.333116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:08.333116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:08.333116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:08.400320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:08.409068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b19d1288-5539-4e24-aec8-af119e6e2e55 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.092002 May 10 14:43:08.410029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 734/1573] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:08.905364 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:08.905982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:08.914947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:08.915452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:08.916243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:08.916679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:09.142710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:09.158542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e0aaf497-f5a9-40b4-9cbb-b6f1b79fe0a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.256939 May 10 14:43:09.161191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 840/1574] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:08 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:09.429770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:09.430779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:09.441310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:09.442073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:09.443384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:09.444133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:09.543370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:09.556857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7dcfeba-8dbc-455c-a479-bbcc31d62d4f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.131369 May 10 14:43:09.556857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 735/1575] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:10.180524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:10.181297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:10.189402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:10.189948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:10.191508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:10.192021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:10.413680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:10.421646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6fc458cb-6d95-4296-a03b-fe4b84fee772 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.245146 May 10 14:43:10.422240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 841/1576] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:10 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:10.573100 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:10.574715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:10.583962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:10.585097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:10.586660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:10.587706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:10.670402 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:10.680009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f77e15c4-2cd1-4431-aade-4db684225970 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.110728 May 10 14:43:10.680802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 736/1577] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:11.439894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:11.441130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:11.449438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:11.456829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:11.456829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:11.456829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:11.607746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:11.617318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fe2899b1-7852-48ce-9674-292157bc783d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.181358 May 10 14:43:11.629368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 842/1578] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:11 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:11.697520 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:11.698131 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:11.705656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:11.706843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:11.707660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:11.708091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:11.778997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:11.791217 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2f67d63-8536-4fbc-9968-bf632d860db8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.097446 May 10 14:43:11.792129 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 737/1579] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:11 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:12.636826 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:12.637443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:12.643869 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:12.644338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:12.645091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:12.645525 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:12.807164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:12.812275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:12.812275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:12.815464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d30fd23f-9a01-4cf3-a80d-e95b981796d4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.182441 May 10 14:43:12.816054 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 843/1580] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:12 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:12.817695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:12.818149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:12.818971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:12.819401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:12.885971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:12.894820 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b44b0c7-30ab-42d9-9e32-d33741ef99c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087746 May 10 14:43:12.894980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 738/1581] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:13.833574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:13.834220 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:13.841737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:13.842193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:13.843036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:13.843472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:13.912234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:13.913803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:13.921172 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:13.921469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:13.922602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:13.923411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:14.002045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:14.014293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52a7e500-4b17-4ac7-8ff9-0d6057e123fc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.102850 May 10 14:43:14.014293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 739/1582] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:14.020261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:14.028495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8f4d5348-023c-4ea2-b9cd-d4192124bb23 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.199346 May 10 14:43:14.030664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 844/1583] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:13 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:15.027786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:15.028675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:15.036648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:15.039528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:15.039528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:15.039528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:15.052818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:15.053619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:15.060167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:15.060621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:15.061706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:15.062105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:15.136881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:15.153644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-764e05a6-d70c-45c6-a964-b8be942a3aa7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.129530 May 10 14:43:15.155028 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 740/1584] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:15.257417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:15.265742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-342fd54f-be1d-4f25-8790-e528b790d88f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.220697 May 10 14:43:15.266434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 845/1585] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:15 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:16.185648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:16.186271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:16.192839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:16.193295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:16.194079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:16.194542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:16.257528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:16.266441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7b82f79-0329-4267-a964-cd5a3208fcfb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084638 May 10 14:43:16.267012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 741/1586] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:16.283721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:16.285367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:16.291737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:16.292202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:16.293007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:16.293436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:16.429418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:16.437649 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9891bfd3-342e-44cd-83ba-02d87438ab1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157751 May 10 14:43:16.438152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 846/1587] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:16 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:17.283784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:17.284760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:17.291268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:17.291709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:17.292478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:17.292909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:17.359883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:17.368871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a68827b-1a93-4d45-b8b2-ac6ce31cc0be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088919 May 10 14:43:17.369427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 742/1588] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:17.457173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:17.457805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:17.466345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:17.466808 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:17.467784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:17.468051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:17.606990 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:17.616300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e622d39c-8a0e-4d19-97b1-c3812330f36e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164029 May 10 14:43:17.616881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 847/1589] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:17 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:18.387476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:18.388091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:18.395501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:18.395947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:18.396720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:18.397156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:18.458830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:18.466799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3e3055c-9b6a-4623-97f5-ad8e24b2081c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083216 May 10 14:43:18.467414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 743/1590] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:18.633526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:18.696966 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:18.696966 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:18.696966 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:18.696966 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:18.697446 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:18.782782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:18.791355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-85a90abd-ad77-4568-8828-fb72392ffd1b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161705 May 10 14:43:18.792156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 848/1591] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:18 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:19.484525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:19.485128 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:19.493880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:19.493880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:19.495316 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:19.495316 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:19.558484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:19.566663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-93749278-bbe6-4777-b30b-a10e6d83d7da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085941 May 10 14:43:19.567233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 744/1592] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:19.809013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:19.809651 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:19.815791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:19.816252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:19.817036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:19.817469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:19.956502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:19.964644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f3398aa6-12f8-40ea-86ca-60a156c0058b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159455 May 10 14:43:19.965223 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 849/1593] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:19 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:20.583973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:20.584581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:20.591060 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:20.591556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:20.592283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:20.592715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:20.656436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:20.665738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-340309ce-2cc8-4481-9be7-bef8aaebd332 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085759 May 10 14:43:20.666321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 745/1594] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:20.982062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:20.982739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:20.989681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:20.990134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:20.990960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:20.993981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:21.126539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:21.135207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cf9d1644-49c7-4a13-aacd-c542d0068bfe tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157000 May 10 14:43:21.135791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 850/1595] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:20 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:21.683499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:21.684146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:21.691270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:21.691729 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:21.692542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:21.692986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:21.761964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:21.771545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-023e3822-0f10-446d-90bf-43d21455f4a0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.091855 May 10 14:43:21.775409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 746/1596] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:22.152634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:22.153306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:22.161653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:22.162100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:22.162979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:22.163378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:22.306925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:22.316518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-56e82c30-2b6c-4373-b723-319128c6db39 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.167792 May 10 14:43:22.317531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 851/1597] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:22 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:22.791300 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:22.792082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:22.800825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:22.801467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:22.802332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:22.802774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:22.879335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:22.887551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c54447bd-c757-42ad-b63f-29ebe43fc061 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.100899 May 10 14:43:22.888115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 747/1598] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:22 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:23.334729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:23.335351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:23.342193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:23.342668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:23.343431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:23.343863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:23.474747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:23.483160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e54d5a87-9991-4e13-8c29-62fceb0743be tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153008 May 10 14:43:23.483736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 852/1599] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:23 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:23.907035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:23.907640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:23.914598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:23.915073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:23.915875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:23.916320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:23.978584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:23.987523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-efb94b0c-39bd-4db1-96da-54bfd8f5b9e8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084832 May 10 14:43:23.988327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 748/1600] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:24.501179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:24.501864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:24.508945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:24.509397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:24.510167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:24.510632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:24.644036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:24.652289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c74b6f0c-3f79-43dd-84d5-bd7a80cbb49a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154948 May 10 14:43:24.652942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 853/1601] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:24 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:25.005325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:25.005951 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:25.012230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:25.012675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:25.013437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:25.013870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:25.076210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:25.084759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81c4c962-2061-442f-86c3-50af6871ff95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083821 May 10 14:43:25.085318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 749/1602] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:25.670501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:25.671114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:25.678309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:25.678763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:25.679539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:25.679976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:25.811800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:25.819617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6e8b7db5-64ac-4457-bef3-9166767c68a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153051 May 10 14:43:25.820199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 854/1603] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:25 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:26.102598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:26.103158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:26.109742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:26.110185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:26.111245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:26.111681 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:26.174020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:26.182662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2b390b4-33ec-412d-b9f5-6d4f46325e7a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084039 May 10 14:43:26.183234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 750/1604] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:26.838947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:26.839590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:26.846258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:26.846644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:26.847992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:26.848436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:26.993320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:27.001118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-03c28fa1-fc54-4e7d-a482-d0119289feb6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.167252 May 10 14:43:27.001685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 855/1605] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:26 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:27.199871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:27.200508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:27.209138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:27.209593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:27.210399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:27.210829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:27.274133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:27.282163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63bfaf26-43df-4571-8bab-4b12ea2c2d19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086148 May 10 14:43:27.282766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 751/1606] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:28.019985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:28.020588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:28.027171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:28.027618 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:28.028392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:28.028820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:28.161560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:28.169501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6118fc10-a531-49e9-b483-84f2c9ec6347 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154032 May 10 14:43:28.170102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 856/1607] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:28 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:28.299955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:28.300589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:28.306922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:28.307377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:28.308182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:28.308619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:28.370814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:28.380415 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a142a418-845c-4196-869e-ea29472ccf33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085077 May 10 14:43:28.380983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 752/1608] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:29.187478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:29.188299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:29.197305 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:29.198075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:29.199368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:29.200109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:29.339424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:29.347376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-774c22f9-7eb6-4c79-ae75-86f4dd13ab16 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.163965 May 10 14:43:29.347981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 857/1609] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:29 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:29.398190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:29.398825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:29.405168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:29.405615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:29.406427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:29.406860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:29.471325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:29.481535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7edf608e-ba35-4730-8134-348b310c9e78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087180 May 10 14:43:29.482120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 753/1610] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:30.366131 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:30.366786 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:30.373425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:30.373865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:30.374664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:30.375097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:30.499274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:30.499927 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:30.506519 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:30.506973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:30.507759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:30.508200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:30.513341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:30.525622 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1acfc113-08bd-444b-972d-4e04dd552d98 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164441 May 10 14:43:30.526684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 858/1611] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:30 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:30.576981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:30.585986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9cc67a55-858f-4d2c-a67d-1abfca34630a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090606 May 10 14:43:30.588739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 754/1612] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:31.544008 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:31.544737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:31.551879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:31.552323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:31.553284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:31.553721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:31.603495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:31.604112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:31.610644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:31.611348 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:31.615173 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:31.615680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:31.697812 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:31.707092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ec850019-6456-483c-9143-eb08fd87a74c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.107394 May 10 14:43:31.707877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 755/1613] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:31 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:31.724184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:31.732237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-79aeddf9-278e-42ce-a563-e785fabb53cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.192186 May 10 14:43:31.732831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 859/1614] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:31 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:32.724822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:32.725471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:32.732045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:32.732494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:32.733276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:32.733716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:32.749317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:32.749980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:32.757430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:32.757879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:32.758698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:32.759136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:32.802517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:32.811586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d7800bc1-2b7c-4fe6-b4d8-5eedd3918ccf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.091022 May 10 14:43:32.812192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 756/1615] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:32.906349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:32.915123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3f962d05-391b-467b-88e7-ea4a335d8448 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.169999 May 10 14:43:32.915690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 860/1616] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:32 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:33.828693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:33.829258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:33.835565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:33.836018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:33.836793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:33.837230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:33.911655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:33.919708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c7b1625-3667-438c-a6f5-0078687901da tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.095015 May 10 14:43:33.920282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 757/1617] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:33 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:33.932788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:33.933401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:33.940137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:33.940707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:33.941483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:33.941918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:34.082052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:34.090127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e1c0ae03-a522-4b3e-b321-cac28abaf3fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161135 May 10 14:43:34.090725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 861/1618] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:33 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:34.937961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:34.938587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:34.946142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:34.946618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:34.947525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:34.947953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:35.014113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:35.022537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd6bac35-d835-469c-a2fb-b69f8a773f83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088290 May 10 14:43:35.023109 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 758/1619] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:35.109120 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:35.109852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:35.117084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:35.117536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:35.118347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:35.118776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:35.254652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:35.264329 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b34ed194-54c5-4977-bf39-56eb6d1ee447 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159491 May 10 14:43:35.264898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 862/1620] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:35 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:36.039709 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:36.040304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:36.046795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:36.047242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:36.048017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:36.048455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:36.109143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:36.117619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20c66d3a-29c8-4021-95a4-60292432db1e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081789 May 10 14:43:36.118223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 759/1621] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:36 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:36.281936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:36.282582 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:36.289062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:36.289645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:36.290382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:36.290766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:36.419838 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:36.428646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-17888a37-c513-4313-a254-8eb978bb3d3b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150603 May 10 14:43:36.429230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 863/1622] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:36 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:37.135647 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:37.136248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:37.142931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:37.143487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:37.144347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:37.144778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:37.212546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:37.220372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37939f4f-09f3-4a17-9d12-d2abfeef7005 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088797 May 10 14:43:37.221019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 760/1623] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:37.446751 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:37.447313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:37.453825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:37.454302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:37.455137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:37.455575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:37.583220 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:37.590983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-914d80b6-78c0-4fd4-8ec7-8832ed13a658 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148211 May 10 14:43:37.591556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 864/1624] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:37 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:38.239719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:38.240322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:38.247295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:38.247759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:38.248545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:38.248977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:38.316724 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:38.324737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6bce57f3-bf29-4826-800e-556fbafeede8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090672 May 10 14:43:38.325288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 761/1625] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:38.608735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:38.609298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:38.616687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:38.617134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:38.617908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:38.618376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:38.754705 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:38.762538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-98bf7fd8-af90-43aa-8f4b-6643afd122eb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157778 May 10 14:43:38.763116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 865/1626] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:38 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:39.342569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:39.343147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:39.350338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:39.350784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:39.351567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:39.352001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:39.416685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:39.425478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8d50a45-713a-4bb5-ab7c-5614b8ee3c49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087107 May 10 14:43:39.426244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 762/1627] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:39.779001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:39.779608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:39.786092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:39.786629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:39.787397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:39.787830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:39.917804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:39.925778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-05c12ba0-1d03-4223-8218-4b4e79dee7bc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150730 May 10 14:43:39.926371 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 866/1628] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:39 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:40.442288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:40.442913 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:40.449210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:40.449658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:40.450453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:40.450883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:40.515783 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:40.524081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f81c1c4-44c2-45ef-b6c1-dd5efaa4aac9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086287 May 10 14:43:40.524661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 763/1629] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:40 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:40.942992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:40.943603 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:40.950024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:40.950492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:40.951325 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:40.951764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:41.087547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:41.096517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-12cbc446-63a8-4dd5-848a-309731d1b47f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156945 May 10 14:43:41.097089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 867/1630] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:40 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:41.543506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:41.544199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:41.552256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:41.552439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:41.553214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:41.553715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:41.617041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:41.625777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1d98aa1b-1572-4f26-8ee3-ad21cdbf514a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086369 May 10 14:43:41.626391 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 764/1631] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:42.114487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:42.115098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:42.121779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:42.122245 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:42.123024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:42.123458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:42.254134 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:42.262111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d82231ad-b91d-437f-97b5-a06fb168b782 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151974 May 10 14:43:42.262711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 868/1632] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:42 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:42.643218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:42.644024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:42.651572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:42.652064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:42.652890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:42.653330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:42.719081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:42.728813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f3dfdda5-2fdb-4b2e-93d1-629db103fbad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090269 May 10 14:43:42.729396 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 765/1633] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:43.280146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:43.280951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:43.287278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:43.287731 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:43.288508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:43.288948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:43.418485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:43.426904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aec18f3b-3366-4ac3-9e23-4eae4dc198bd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150692 May 10 14:43:43.427483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 869/1634] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:43 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:43.746043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:43.746678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:43.753688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:43.754134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:43.754964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:43.755398 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:43.821551 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:43.829688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d991bd9-83fe-4add-884e-b6661cecd37f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087563 May 10 14:43:43.830935 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 766/1635] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:43 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:44.444881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:44.445491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:44.452933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:44.453398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:44.454183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:44.454654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:44.584601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:44.592734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2010fb43-574f-4682-8011-150f2847eb05 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151684 May 10 14:43:44.593459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 870/1636] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:44 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:44.847298 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:44.847895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:44.854160 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:44.854642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:44.855408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:44.855837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:44.918537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:44.926570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23c37320-343f-4859-9243-e23af15e2b76 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083653 May 10 14:43:44.927137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 767/1637] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:44 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:45.610952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:45.612296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:45.618694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:45.619140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:45.619913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:45.620350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:45.752678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:45.760685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f8a943a3-4298-4761-a9a4-7b09afde7a0a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153529 May 10 14:43:45.761402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 871/1638] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:45 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:45.944021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:45.944687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:45.951457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:45.951682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:45.952439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:45.952871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:46.016063 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:46.024475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d88f9c71-2552-4141-92b0-512f20a122b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084654 May 10 14:43:46.025127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 768/1639] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:46.777465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:46.778427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:46.785032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:46.785494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:46.786326 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:46.786774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:46.924716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:46.932654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8cb2bf22-29a8-4bbf-8766-d160fe4d2229 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159165 May 10 14:43:46.933237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 872/1640] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:46 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:47.041996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:47.042795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:47.049708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:47.050540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:47.051797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:47.052233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:47.124340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:47.133298 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17f90e5a-5b94-4602-9b0c-5b6eac13eb91 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.095182 May 10 14:43:47.133895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 769/1641] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:47 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:47.950989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:47.951582 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:47.958384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:47.958837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:47.959603 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:47.960038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:48.088343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:48.096495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-68219c5a-c114-4d7d-8938-d1d5c5de617d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149337 May 10 14:43:48.097243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 873/1642] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:47 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:48.149390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:48.150002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:48.156722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:48.157177 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:48.158006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:48.158606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:48.221453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:48.229343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8c8229b8-89b4-4b78-924e-2a18aaa90e2e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083775 May 10 14:43:48.229922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 770/1643] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:49.114815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:49.115606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:49.122192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:49.122676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:49.123460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:49.123897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:49.246485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:49.247114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:49.254247 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:49.254679 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:49.255457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:49.255889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:49.261676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:49.270698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-49b65c3d-d858-4f8d-845d-7ce5307b7203 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160574 May 10 14:43:49.271295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 874/1644] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:49 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:49.319838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:49.328923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86caa05e-5c5b-4aa5-99ad-5320cadd3112 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086426 May 10 14:43:49.329508 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 771/1645] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:50.288014 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:50.288646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:50.295145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:50.295588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:50.296353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:50.296785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:50.347289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:50.347976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:50.354627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:50.355082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:50.355851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:50.356371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:50.427011 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:50.434835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2b4e125-1ecb-45ba-baf0-f2f10ba5c158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.092078 May 10 14:43:50.435418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 772/1646] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:50 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:50.448842 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:50.457578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6ec7111-e8d2-4502-bfdf-94f968810814 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.173523 May 10 14:43:50.458147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 875/1647] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:50 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:51.452761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:51.453364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:51.460371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:51.460824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:51.461587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:51.462016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:51.475815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:51.476420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:51.482802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:51.483246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:51.484012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:51.484447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:51.528917 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:51.537930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fed8f76f-2a09-4bfd-b7c5-dd076e2b0e41 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089336 May 10 14:43:51.538554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 773/1648] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:51 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:51.624534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:51.632578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a794c16-9582-432d-8f41-cee4a200d29d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160744 May 10 14:43:51.633156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 876/1649] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:51 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:52.555440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:52.556045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:52.562361 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:52.562804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:52.563558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:52.564112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:52.625686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:52.633513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c79f647b-7d92-4fe0-b35d-adea910f6781 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082067 May 10 14:43:52.634078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 774/1650] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:43:52.649645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:52.650389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:52.656715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:52.657161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:52.658523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:52.658961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:52.791491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:52.799891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e64c3f89-251f-42d7-af1d-d186336005e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154118 May 10 14:43:52.800466 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 877/1651] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:52 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:53.650176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:53.650815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:53.657122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:53.657645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:53.658629 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:53.659065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:53.719611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:53.727682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c13aa555-ba20-4254-b565-b7f63773a1c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081377 May 10 14:43:53.728254 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 775/1652] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:53 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:53.818136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:53.818735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:53.825033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:53.825483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:53.826281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:53.826722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:53.957452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:53.965304 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-56aae0e8-e078-48ce-bdaa-5de8c8e15306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152144 May 10 14:43:53.965879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 878/1653] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:53 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:54.744990 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:54.745599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:54.752524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:54.752974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:54.753746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:54.754178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:54.833632 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:54.841466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-403b8834-2438-4970-aec8-35c594af1f28 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.100426 May 10 14:43:54.842250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 776/1654] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:54 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:54.983102 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:54.983722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:54.990980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:54.991428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:54.992213 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:54.992648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:55.322109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:55.330572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-910aa877-3f9b-4f68-b43c-cb05a027fc26 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.351205 May 10 14:43:55.331164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 879/1655] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:54 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:55.859072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:55.859642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:55.867116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:55.867569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:55.868348 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:55.868787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:55.930191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:55.938108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-795c6f33-d011-4663-ae0f-bf07d5bde636 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083138 May 10 14:43:55.938707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 777/1656] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:55 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:56.347876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:56.348473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:56.354799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:56.355249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:56.356043 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:56.356475 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:56.496737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:56.504499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e31e2a55-7792-41b3-a2ec-c70ba7344474 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160511 May 10 14:43:56.505071 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 880/1657] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:56 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:56.955804 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:56.956417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:56.962822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:56.963274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:56.964053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:56.964497 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:57.027674 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:57.035814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-593191d2-3317-4e7c-be72-737692303004 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084488 May 10 14:43:57.036377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 778/1658] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:57.521509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:57.522127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:57.528461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:57.528910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:57.529668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:57.530095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:57.662172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:57.672408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-de10d3e3-6923-48b3-8302-a3f74789ef56 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155394 May 10 14:43:57.673561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 881/1659] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:57 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:58.053305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:58.053921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:58.060315 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:58.060758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:58.061521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:58.061945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:58.124545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:58.133256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f3abeb08-214c-4535-9021-6d79ba2eb6c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083803 May 10 14:43:58.133820 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 779/1660] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:58.691634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:58.692247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:58.698834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:58.699294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:58.700072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:58.700513 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:58.828055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:58.836914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5c7549bf-8092-4103-b8eb-439d0d8ecf3f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149637 May 10 14:43:58.837504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 882/1661] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:58 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:59.154177 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:59.154831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:59.161152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:59.161599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:59.162404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:59.162840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:59.223986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:43:59.231835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a228d02a-8563-492f-aa18-f91abed6ff35 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081560 May 10 14:43:59.232401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 780/1662] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:43:59.857107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:43:59.858064 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:43:59.867606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:59.868123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:43:59.868915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:43:59.869350 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:00.012430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:00.021628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba8a3690-9e1f-406e-b46b-cf91b0f2edff tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.170867 May 10 14:44:00.022232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 883/1663] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:43:59 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:00.251872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:00.252714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:00.261894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:00.262603 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:00.263782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:00.264434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:00.327215 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:00.335727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30150751-9ccc-4d01-84d9-d741b9b5799e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090502 May 10 14:44:00.336313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 781/1664] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:01.039811 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:01.040373 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:01.046703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:01.047148 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:01.047933 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:01.048926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:01.182351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:01.191166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-86cd1bd2-869f-4c44-b98f-b0ed9f06c798 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155489 May 10 14:44:01.191732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 884/1665] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:01 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:01.353236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:01.353799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:01.360051 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:01.360494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:01.361524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:01.361969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:01.422483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:01.430587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf698f2a-216c-447c-b8f8-0fcf0308c2af tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081235 May 10 14:44:01.431167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 782/1666] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:02.208753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:02.209387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:02.215701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:02.216169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:02.216934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:02.217372 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:02.348763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:02.356505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d672ca91-1877-41ce-b5c9-328499eb9720 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151628 May 10 14:44:02.357089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 885/1667] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:02 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:02.446945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:02.447759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:02.454002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:02.454664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:02.455439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:02.455867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:02.519321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:02.527183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0baeb4ab-316f-468a-8912-a51d22b4f1cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084266 May 10 14:44:02.527755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 783/1668] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:03.374111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:03.374742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:03.382324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:03.382804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:03.383595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:03.384027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:03.517214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:03.525682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cfbc3277-fe0c-4422-b699-5c0d85b13f9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155651 May 10 14:44:03.526269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 886/1669] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:03 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:03.545018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:03.545623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:03.552347 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:03.552962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:03.553688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:03.554117 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:03.616090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:03.623906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-85e6e66a-bf68-4a1f-8579-cdeec500633f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083128 May 10 14:44:03.624523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 784/1670] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:04.542688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:04.543337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:04.551311 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:04.551764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:04.552629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:04.553075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:04.641213 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:04.642021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:04.648877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:04.649328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:04.650104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:04.650572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:04.687028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:04.696059 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f3ef331f-bf05-4dc2-9406-4299fc47d3d0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157305 May 10 14:44:04.697004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 887/1671] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:04 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:04.715397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:04.729490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b775aa88-eb7e-4c0c-a867-54d85acbba49 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.092142 May 10 14:44:04.730085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 785/1672] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:05.725323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:05.725929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:05.732283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:05.732784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:05.733617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:05.734049 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:05.747554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:05.748095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:05.754921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:05.755362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:05.756135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:05.756559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:05.832272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:05.840271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6eedd435-5022-4aae-8932-38e84bd9abac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.096640 May 10 14:44:05.840848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 786/1673] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:05.889275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:05.898484 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e0e2e90-b6aa-4fea-980a-8c6369713dae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.176963 May 10 14:44:05.899050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 888/1674] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:05 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:06.856922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:06.857686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:06.864806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:06.865256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:06.866035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:06.866493 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:06.916069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:06.917376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:06.923989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:06.930687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:06.930687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:06.930687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:06.935318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:06.948487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-faffa0f0-b6d1-4da9-83fa-8c538327302b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.095361 May 10 14:44:06.949073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 787/1675] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:07.056017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:07.064486 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d1e73b84-7651-46ec-938f-621f1c5b6fac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152538 May 10 14:44:07.065101 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 889/1676] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:06 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:07.965962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:07.966598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:07.972983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:07.973433 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:07.974256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:07.974695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:08.038289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:08.046565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e88c5c31-652d-421d-82e2-d5a3dbcb24ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084111 May 10 14:44:08.047182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 788/1677] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:08.080995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:08.081609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:08.088175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:08.088636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:08.089425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:08.089865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:08.228589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:08.237717 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9b9d5b75-2357-4fe7-b30e-04b5227e7f11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160648 May 10 14:44:08.238315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 890/1678] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:08 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:09.065714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:09.066714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:09.074919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:09.075980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:09.077015 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:09.077588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:09.153663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:09.164595 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1d8d5ce5-db1d-4cb4-a7b3-038b223c11b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.103990 May 10 14:44:09.166156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 789/1679] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:09.255531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:09.256233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:09.262640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:09.263302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:09.263897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:09.264428 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:09.422258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:09.441540 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-70829b88-be7d-4c3e-8f20-a4e55b6cf332 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.189907 May 10 14:44:09.442175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 891/1680] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:09 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:10.183455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:10.184085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:10.191122 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:10.191561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:10.192336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:10.192811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:10.258272 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:10.266103 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0086b47-77bf-4f97-8338-e48acd2986de tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086563 May 10 14:44:10.267821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 790/1681] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:10.459752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:10.460354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:10.466648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:10.467099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:10.467864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:10.468299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:10.599916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:10.607964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1f3f571f-c952-4475-8765-977243b1f81d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152152 May 10 14:44:10.608532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 892/1682] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:10 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:11.284933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:11.285545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:11.292154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:11.292600 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:11.293370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:11.293800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:11.357858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:11.367372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-984d0080-6973-49b5-b985-4d925c00c441 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087380 May 10 14:44:11.367952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 791/1683] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:11 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:11.624982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:11.625694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:11.632864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:11.633327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:11.634290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:11.634644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:11.771340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:11.784738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9ab2ecd9-f54c-48ce-a363-4719b4ff7202 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.163616 May 10 14:44:11.785319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 893/1684] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:11 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:12.385186 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:12.385857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:12.392411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:12.392924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:12.393692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:12.394124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:12.455490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:12.463780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a95318d2-11dd-48ad-997e-b45fb8e17f5d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082537 May 10 14:44:12.464362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 792/1685] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:12.802807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:12.803684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:12.809708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:12.810152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:12.810937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:12.811380 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:12.952321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:12.960744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3c53a76-cad6-4409-bd06-e18a8bf26961 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161814 May 10 14:44:12.961310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 894/1686] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:12 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:13.480815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:13.481414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:13.488209 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:13.488634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:13.489399 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:13.489828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:13.555159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:13.563727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f2434f9-a671-47b0-83ae-01855bba5948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086050 May 10 14:44:13.564156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 793/1687] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:13.978544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:13.979153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:13.986700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:13.987151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:13.987929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:13.988368 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:14.116117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:14.123946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6d63c314-9826-481a-9019-3dda989d4a52 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149325 May 10 14:44:14.124542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 895/1688] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:13 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:14.581337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:14.581973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:14.588610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:14.589061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:14.589840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:14.590312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:14.653911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:14.662906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e04c9bf-e7eb-478f-a2f3-1cfd3ef9d32a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085888 May 10 14:44:14.663479 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 794/1689] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:14 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:15.143266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:15.143950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:15.150942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:15.151391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:15.152174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:15.152804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:15.297078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:15.305822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-91487bca-ebab-4d5d-8f03-11719ad5e79d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.168082 May 10 14:44:15.306467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 896/1690] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:15 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:15.680077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:15.680673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:15.691635 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:15.692082 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:15.692864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:15.693292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:15.770441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:15.778676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e33abf9-b5f1-452d-92c0-f56f5ced8018 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.102432 May 10 14:44:15.779259 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 795/1691] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:16.324468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:16.325070 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:16.332567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:16.333012 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:16.333870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:16.334331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:16.476307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:16.484176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa34a3ce-9c54-4436-9c53-ba5094bea1b4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.163636 May 10 14:44:16.484799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 897/1692] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:16 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:16.797593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:16.798455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:16.804975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:16.805430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:16.806287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:16.806724 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:16.872419 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:16.881383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36f1f61f-33a1-46c4-8d77-faaeddef8d32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087663 May 10 14:44:16.881962 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 796/1693] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:17.502684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:17.503332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:17.509972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:17.510458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:17.511222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:17.511653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:17.650318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:17.658806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5aa7a74a-d07f-4ae7-acc8-a24587f3e399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160369 May 10 14:44:17.659384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 898/1694] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:17 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:17.898605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:17.899242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:17.905664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:17.906111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:17.907467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:17.907906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:17.970774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:17.978808 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20edba4b-3a22-4823-9248-068e49c42858 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083895 May 10 14:44:17.979401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 797/1695] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:18.677727 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:18.678392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:18.685298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:18.685748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:18.686567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:18.687009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:18.828009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:18.836719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-688a14d9-4d52-4304-80c4-d99545272d95 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.162977 May 10 14:44:18.837302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 899/1696] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:18 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:18.999684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:19.003282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:19.010835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:19.011299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:19.012143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:19.012573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:19.078485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:19.086798 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13f13dcd-4b17-41e9-b204-1470d26da280 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.093543 May 10 14:44:19.087387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 798/1697] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:19.855016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:19.855892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:19.863081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:19.863533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:19.864317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:19.864756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:19.997810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:20.005897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f97e86f8-66ab-494d-9c85-0547caf41b11 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155333 May 10 14:44:20.006509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 900/1698] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:19 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:20.105485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:20.106268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:20.112877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:20.113331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:20.114110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:20.114592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:20.183441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:20.191747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-759914f6-e110-499d-ae3a-934051b8ef88 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090567 May 10 14:44:20.192321 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 799/1699] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:21.023569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:21.024109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:21.030496 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:21.030948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:21.032217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:21.032650 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:21.167061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:21.175961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ff6cb0ef-0a03-4fea-bf72-7cb2bddd6731 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156390 May 10 14:44:21.176538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 901/1700] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:21 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:21.208794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:21.209406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:21.215767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:21.216216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:21.216986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:21.217423 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:21.278836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:21.287237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-439295d1-3751-4d7d-b933-5b0696f9055a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082384 May 10 14:44:21.287797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 800/1701] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:22.193010 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:22.193621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:22.199980 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:22.200433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:22.201203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:22.201641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:22.304309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:22.304924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:22.311410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:22.311868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:22.314243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:22.314243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:22.342395 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:22.351191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c6df64a8-c091-44d4-b9bf-efff1afdeebd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161953 May 10 14:44:22.351795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 902/1702] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:22 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:22.377377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:22.385818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-634cd279-9e10-45fe-8582-1fff09514890 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085393 May 10 14:44:22.386426 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 801/1703] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:22 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:23.368729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:23.369472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:23.376079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:23.376526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:23.377295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:23.377732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:23.411719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:23.412329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:23.418830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:23.419293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:23.420684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:23.420684 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:23.495789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:23.505120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-979b343d-6c91-48b7-b828-a2e20e5e50ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.097573 May 10 14:44:23.514281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 802/1704] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:23.537036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:23.544972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-67d355c2-fc92-4daa-88b0-060280ef24d6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.180166 May 10 14:44:23.545540 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 903/1705] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:23 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:24.522397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:24.523035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:24.529308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:24.529750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:24.530541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:24.530975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:24.568253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:24.568982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:24.575518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:24.576052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:24.576834 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:24.577270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:24.598373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:24.606163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4858cf57-474a-40e0-b1e4-cdbb1b7df98e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087660 May 10 14:44:24.606758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 803/1706] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:24.712011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:24.720900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bec279bb-ee29-42f7-9a64-019a5082cbf5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156437 May 10 14:44:24.721543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 904/1707] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:24 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:25.623577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:25.624208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:25.631251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:25.631695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:25.632473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:25.632906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:25.695953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:25.705577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0062a8a0-3a63-44e3-a241-e417e42c4290 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085815 May 10 14:44:25.706158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 804/1708] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:25.738817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:25.739422 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:25.745848 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:25.746328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:25.747089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:25.747517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:25.893014 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:25.900817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e4a0a39d-63c3-4211-976a-29ccc3cc994c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.166686 May 10 14:44:25.901388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 905/1709] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:25 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:26.723474 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:26.724077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:26.730433 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:26.730878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:26.731646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:26.732097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:26.793982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:26.802627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aca46821-db4a-4e56-b8ec-e3e33e3eea6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083701 May 10 14:44:26.803192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 805/1710] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:26.918660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:26.919254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:26.925678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:26.926122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:26.926918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:26.927352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:27.058314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:27.066705 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3754cb6d-2260-44f4-8e5e-4cdf2188b91f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152128 May 10 14:44:27.067280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 906/1711] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:26 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:27.819772 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:27.820331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:27.827614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:27.828673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:27.829554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:27.829996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:27.895957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:27.904241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0532644e-d2f6-4bd6-b170-30ff9295f7ff tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088398 May 10 14:44:27.904801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 806/1712] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:28.083712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:28.084273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:28.090746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:28.091203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:28.091975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:28.092416 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:28.223185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:28.231050 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-78532603-741c-49b7-acc4-364eef69ca12 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151292 May 10 14:44:28.231609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 907/1713] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:28 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:28.921026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:28.921619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:28.928404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:28.928853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:28.929614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:28.930044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:28.992711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:29.001598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4b41ea4-f1b5-4545-bd14-1f558b002e12 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084481 May 10 14:44:29.002169 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 807/1714] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:29.249337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:29.250465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:29.256669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:29.257114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:29.257876 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:29.258344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:29.394764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:29.402473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-72937eba-f76c-4c7c-9292-ed06ea6af1ac tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157130 May 10 14:44:29.403034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 908/1715] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:29 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:30.019948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:30.020595 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:30.027106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:30.027555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:30.028327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:30.028759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:30.090119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:30.098453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a697b78-0f61-438a-92e7-7f6765a306a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083700 May 10 14:44:30.099050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 808/1716] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:30.419810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:30.420459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:30.427586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:30.428037 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:30.428816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:30.429255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:30.557846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:30.566450 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b2a25e41-1086-4554-95e3-5b7b7d4aac4b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150605 May 10 14:44:30.567023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 909/1717] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:30 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:31.116983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:31.117584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:31.124641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:31.125393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:31.126193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:31.126656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:31.191108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:31.199042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9013f9c-d64d-4705-9d52-2e4111a0be66 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086191 May 10 14:44:31.199614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 809/1718] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:31 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:31.584090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:31.584767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:31.591426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:31.591891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:31.592677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:31.593124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:31.736729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:31.744873 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1c8062f7-5904-42ca-8c41-5a7aad555a3c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164518 May 10 14:44:31.745445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 910/1719] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:31 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:32.216431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:32.217035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:32.223793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:32.224276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:32.225019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:32.225463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:32.287210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:32.294993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2cfed28-47d2-4ebc-83e2-5271a969486a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082490 May 10 14:44:32.295565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 810/1720] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:32.763260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:32.763915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:32.771530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:32.772003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:32.772778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:32.773216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:32.909284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:32.917194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fc23adf4-f1e8-48e8-8180-fbd401580c36 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157829 May 10 14:44:32.917839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 911/1721] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:32 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:33.313567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:33.314190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:33.320527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:33.320977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:33.321737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:33.322167 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:33.390525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:33.399305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d8c56b87-4ee9-41bf-a022-12874b41ffdd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090149 May 10 14:44:33.399872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 811/1722] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:33 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:33.934487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:33.935074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:33.941440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:33.941886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:33.942668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:33.943108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:34.069974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:34.077853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1089c607-0d8f-43e7-9bc3-387a6e0cb4b8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.147277 May 10 14:44:34.078641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 912/1723] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:33 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:34.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:34.417074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:34.423342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:34.423789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:34.424565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:34.425001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:34.493354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:34.502368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f2a336e-ca92-4fb9-a660-a323b224085f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089688 May 10 14:44:34.502936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 812/1724] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:35.099692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:35.100522 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:35.106804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:35.107248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:35.108020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:35.108446 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:35.239711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:35.247653 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dcd3695e-6cd4-4ee1-a6c2-d8177b7f7468 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151897 May 10 14:44:35.248221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 913/1725] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:35 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:35.519262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:35.519869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:35.526239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:35.526682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:35.527443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:35.527876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:35.591441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:35.601239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50a9f050-d304-4fc9-b0e8-cc851c90674f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086075 May 10 14:44:35.601816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 813/1726] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:36.266744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:36.267352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:36.273718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:36.274163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:36.274962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:36.275404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:36.407946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:36.415904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e0949e5d-5a84-49f9-b87f-6886cd55a354 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153738 May 10 14:44:36.416488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 914/1727] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:36 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:36.619418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:36.620051 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:36.627349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:36.627802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:36.628590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:36.629025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:36.691022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:36.698895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36f851c8-bede-4a5a-9146-0e810ebbc0a7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083480 May 10 14:44:36.699458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 814/1728] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:36 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:37.433617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:37.434241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:37.440708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:37.441154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:37.441913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:37.442387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:37.575260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:37.584467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-92ac0873-2ed1-4068-b8e3-a8016d119d66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154772 May 10 14:44:37.585117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 915/1729] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:37 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:37.716429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:37.716996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:37.723939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:37.724381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:37.725523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:37.725714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:37.794176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:37.802817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ed46e2b-8b59-4221-864a-75e4e641444a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090478 May 10 14:44:37.803394 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 815/1730] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:38.602517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:38.603263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:38.610274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:38.610732 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:38.611766 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:38.612200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:38.744592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:38.752749 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-414bf508-0956-4c9d-a9ca-f47e012459ec tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154280 May 10 14:44:38.753320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 916/1731] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:38 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:38.825720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:38.826364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:38.834003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:38.834484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:38.835268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:38.835708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:38.897427 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:38.905182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ddd7a7e-ce8b-47a2-bfb4-8103a6a643f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083389 May 10 14:44:38.906544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 816/1732] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:39.771815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:39.772724 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:39.779841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:39.780336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:39.781707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:39.782062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:39.918074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:39.922616 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:39.923385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:39.927433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-238f58e5-faf0-4901-a09f-0fa3de000f1a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161394 May 10 14:44:39.927998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 917/1733] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:39 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:39.930553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:39.931007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:39.931810 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:39.932230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:39.998739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:40.006903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-feddc320-6d73-46be-9b28-e0a82a52de96 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088763 May 10 14:44:40.007480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 817/1734] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:40.945054 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:40.945645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:40.952253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:40.953403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:40.954640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:40.955009 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:41.024479 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:41.025219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:41.032700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:41.033153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:41.033940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:41.034403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:41.115711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:41.124263 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21fd98d9-98a7-4960-af56-bbc15d691497 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.103796 May 10 14:44:41.125522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 818/1735] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:41.137159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:41.143433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fd029757-4292-4c3e-939d-fbb26e72b972 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.202288 May 10 14:44:41.144021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 918/1736] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:40 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:42.142141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:42.142785 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:42.149202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:42.149646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:42.150455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:42.150892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:42.162147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:42.162779 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:42.169247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:42.169688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:42.170495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:42.170928 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:42.226115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:42.234890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-269c6bb6-315d-41d7-9f9f-6ab69effd69b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.096162 May 10 14:44:42.235472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 819/1737] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:42.317013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:42.325363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d94ea61a-358d-4590-bd09-d06dad99df07 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.167130 May 10 14:44:42.325936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 919/1738] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:42 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:43.252339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:43.252942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:43.259292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:43.259742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:43.260504 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:43.260941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:43.322216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:43.330371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb920ca3-e9af-4709-9164-0f61e60a3be4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082549 May 10 14:44:43.330946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 820/1739] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:43 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:43.342452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:43.343261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:43.349568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:43.350018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:43.350830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:43.351264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:43.479950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:43.489075 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a7d8eaeb-b569-4e52-a418-3d36cfb37f1d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150488 May 10 14:44:43.489654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 920/1740] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:43 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:44.347968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:44.348605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:44.354687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:44.355136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:44.355911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:44.356346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:44.420213 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:44.428261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29db9d3b-8d89-4b20-b274-0c398259dfbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084715 May 10 14:44:44.428823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 821/1741] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:44 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:44.506401 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:44.507017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:44.513449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:44.513904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:44.514713 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:44.515799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:44.643097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:44.650869 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-accef313-c5d1-47e8-9f7c-c603cfc20a5f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148379 May 10 14:44:44.651566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 921/1742] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:44 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:45.445823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:45.446455 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:45.453717 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:45.453886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:45.454676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:45.455110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:45.518995 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:45.526905 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ef152af5-a1fa-4291-87c8-878df5368f89 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085080 May 10 14:44:45.527466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 822/1743] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:45.668517 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:45.669107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:45.675802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:45.676249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:45.677002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:45.677433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:45.807722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:45.817332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b826b390-8ea6-4d66-a78b-684341be4525 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152723 May 10 14:44:45.817907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 922/1744] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:45 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:46.544402 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:46.545032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:46.551862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:46.552305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:46.553068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:46.553496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:46.615388 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:46.623533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a7c91fe-ee9a-4f03-bd19-95982ed0ebc0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083029 May 10 14:44:46.624607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 823/1745] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:46 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:46.836785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:46.837347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:46.845074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:46.845523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:46.846328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:46.846765 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:46.984061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:46.992497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e59af590-0606-400e-9557-ce95fae310dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.160300 May 10 14:44:46.993062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 923/1746] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:46 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:47.642066 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:47.642715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:47.649035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:47.649475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:47.650266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:47.650700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:47.713780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:47.722358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0320ec8b-7b6a-476c-924a-0fc7bb8c5743 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084590 May 10 14:44:47.722940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 824/1747] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:47 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:48.010345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:48.010987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:48.017488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:48.017938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:48.018742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:48.019180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:48.147946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:48.156152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60a2b98d-899b-40a7-b28d-6415f7e2a436 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149193 May 10 14:44:48.156819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 924/1748] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:48 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:48.739842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:48.740486 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:48.746921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:48.747365 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:48.748159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:48.748592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:48.813064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:48.820912 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-976201a6-dad2-4626-8f65-4dc39dd2ccbb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085373 May 10 14:44:48.821652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 825/1749] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:49.174217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:49.174841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:49.181169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:49.181613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:49.182452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:49.182847 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:49.311534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:49.320104 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-69f82e3e-c567-4f59-9ff5-da061c7dfb58 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150717 May 10 14:44:49.322430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 925/1750] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:49 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:49.838730 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:49.839318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:49.850159 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:49.850831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:49.851636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:49.852072 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:49.915216 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:49.923305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9f7e6a2-589e-4713-a3b5-64c15a90951a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088489 May 10 14:44:49.923865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 826/1751] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:50.337490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:50.338096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:50.345151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:50.345592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:50.346392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:50.346833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:50.476781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:50.484674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-78963398-8102-4fe1-ba63-b16d9a62c0e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151062 May 10 14:44:50.485238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 926/1752] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:50 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:50.940778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:50.941383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:50.947739 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:50.948195 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:50.948970 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:50.949408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:51.012135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:51.022614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4342c78-f90a-48c6-b34d-ca2fd24d773c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086169 May 10 14:44:51.023205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 827/1753] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:50 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:51.502672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:51.503295 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:51.509690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:51.510143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:51.510941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:51.511383 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:51.641457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:51.649760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cfcc49cd-2e7f-495e-a9d7-74d70c87f14c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151114 May 10 14:44:51.650453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 927/1754] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:51 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:52.040661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:52.041260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:52.047795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:52.048254 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:52.049037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:52.049471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:52.113296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:52.121255 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ccee33e-127a-4938-8820-984722b8fc78 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084486 May 10 14:44:52.121813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 828/1755] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:52.668018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:52.668631 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:52.676053 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:52.676500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:52.677259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:52.677688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:52.808236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:52.816536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-893a98f3-3f10-4ab4-84d2-18e73e754c3d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152411 May 10 14:44:52.817124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 928/1756] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:52 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:53.139007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:53.140200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:53.146728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:53.147181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:53.147956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:53.148392 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:53.209318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:53.217483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-204e509a-7e3a-4ba1-ba30-25bef1504f82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082368 May 10 14:44:53.218694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 829/1757] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:53 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:53.834010 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:53.834603 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:53.840974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:53.841433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:53.842227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:53.842670 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:53.980925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:53.989851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2f29a933-20ee-43ac-9cba-5d95960e54ef tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159808 May 10 14:44:53.990453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 929/1758] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:53 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:54.235780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:54.236387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:54.243073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:54.243614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:54.244386 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:54.244821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:54.305881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:54.313947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4de120a-d243-4ec8-8fcd-ab1ae9389c3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083004 May 10 14:44:54.314553 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 830/1759] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:54 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:55.007592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:55.008159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:55.015022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:55.015801 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:55.016580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:55.017021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:55.143318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:55.151126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fea8627d-cec3-4be1-be2a-5bb0ce2ce10d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.147464 May 10 14:44:55.151696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 930/1760] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:55 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:55.330416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:55.330959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:55.337324 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:55.337778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:55.338576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:55.339013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:55.407821 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:55.415715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-55e39704-fa55-4434-ba26-3ba4ffbdc48f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089438 May 10 14:44:55.416276 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 831/1761] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:55 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:56.169206 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:56.169810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:56.177740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:56.178211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:56.179005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:56.179446 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:56.375390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:56.383191 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8d6f708f-d306-451b-986d-d159aa82dd67 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.218099 May 10 14:44:56.383769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 931/1762] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:56 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:56.432860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:56.433498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:56.439823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:56.440270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:56.441038 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:56.441475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:56.505916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:56.513838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5729c692-a03a-48ad-a34b-a6a55f39f3ac tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084789 May 10 14:44:56.514409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 832/1763] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:57.401297 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:57.401988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:57.408892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:57.409349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:57.410127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:57.410602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:57.531316 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:57.531936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:57.538833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:57.539292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:57.540095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:57.540532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:57.791287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:57.799355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-617d6af5-e641-4384-b709-e0572b3ff409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.272553 May 10 14:44:57.800044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 833/1764] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:57.807126 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:57.816636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c63f67b7-9796-4fe6-b71d-e1c0d9145f71 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.419184 May 10 14:44:57.817209 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 932/1765] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:57 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:58.816808 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:58.817431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:58.823700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:58.824142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:58.824901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:58.825330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:58.834534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:58.835150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:58.841244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:58.841692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:58.842570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:58.843007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:58.896274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:58.904435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-982d828b-1529-4202-8f0d-869efb68c054 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.091476 May 10 14:44:58.905013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 834/1766] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:44:58.984867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:44:58.992974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-892df56d-6d98-4a92-8114-1cb51aa63bf0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.162959 May 10 14:44:58.993536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 933/1767] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:58 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:44:59.921311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:44:59.921940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:44:59.928311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:59.928765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:59.929528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:44:59.929960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:44:59.997013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:00.005662 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c31132b2-f036-4f5b-99e0-24265c69e409 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088202 May 10 14:45:00.008990 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 835/1768] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:44:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:00.011118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:00.011761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:00.018979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:00.019415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:00.020185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:00.020684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:00.147974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:00.155906 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-801209b0-95d3-4fa3-ba01-0b9f07aae3a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148909 May 10 14:45:00.156481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 934/1769] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:00 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:01.023567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:01.024136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:01.031049 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:01.031496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:01.032265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:01.032721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:01.096708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:01.104471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ef911df-4509-473b-ab2b-0b1d222ed041 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085148 May 10 14:45:01.105039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 836/1770] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:01.173299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:01.173899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:01.180534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:01.180983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:01.181892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:01.182252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:01.317193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:01.325061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f2bb2c7e-493b-4f43-9d69-fc3536942d55 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.155750 May 10 14:45:01.325626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 935/1771] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:01 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:02.122765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:02.124172 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:02.130449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:02.130910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:02.131682 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:02.132118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:02.197326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:02.205447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b0358d49-f95f-4453-bf5e-5017b0a8dcd0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086788 May 10 14:45:02.206120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 837/1772] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:02.344499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:02.345170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:02.352007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:02.354845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:02.354845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:02.354845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:02.495104 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:02.503316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-766f9e77-e313-4868-a3a9-18f5df318399 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164174 May 10 14:45:02.503896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 936/1773] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:02 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:03.222607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:03.223223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:03.229689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:03.230142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:03.230949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:03.231383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:03.293950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:03.302338 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb2bde2b-ea62-4897-a93d-9b33fe656407 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083545 May 10 14:45:03.302910 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 838/1774] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:03.520874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:03.521489 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:03.528215 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:03.528671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:03.529448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:03.530034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:03.659151 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:03.667170 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7af12b09-b626-49bd-8e23-a0c4090810e1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150274 May 10 14:45:03.667756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 937/1775] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:03 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:04.320370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:04.321129 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:04.328071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.328504 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.329281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.329712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.385168 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:04.385972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:04.393872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.394427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.395064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:04.395263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.396027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.403180 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d615c67-b62a-42da-ba45-596191e488cc tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086843 May 10 14:45:04.403751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 839/1776] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:04.429145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:45:04.685051 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:04.686833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:04.692985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.694278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.694278 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.694734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.784913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-94c02a95-013f-49e1-9879-21ebcc4ebcf0 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 204 len: 0 microversion: 2.1 time: 0.403687 May 10 14:45:04.785534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 938/1777] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:45:04 2022] DELETE /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:45:04.793927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:04.797508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:04.800930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.801621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.802418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:04.802947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:04.837330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:04.846870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea455319-40f9-4ae0-b96c-91e486088970 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.165480 May 10 14:45:04.847485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 840/1778] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:04 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:04.943355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:04.950811 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0aad3dec-aad8-4de3-b864-60e6239e579d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1681 microversion: 2.1 time: 0.160979 May 10 14:45:04.951417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 939/1779] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:04 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:05.422132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:05.422756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:05.429083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:05.429524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:05.430312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:05.430742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:05.495273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:05.504135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6b3fe6d8-861e-404e-ac58-605c033e2d77 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086615 May 10 14:45:05.504708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 841/1780] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:05.865153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:05.865802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:05.872341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:05.872798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:05.873790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:05.874264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:05.968931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:05.969570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:05.975932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:05.976320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:05.977102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:05.977531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:06.125737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:06.133719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0cd8f6f5-2b92-4d55-8853-df1558421b9b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.272783 May 10 14:45:06.134435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 940/1781] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:05 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:06.224957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:06.233265 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e624340-d55c-4269-ac0b-187f4e0d1d47 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1681 microversion: 2.1 time: 0.268256 May 10 14:45:06.242986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 842/1782] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:05 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:06.521392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:06.521914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:06.527987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:06.528432 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:06.529196 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:06.530666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:06.614975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:06.622734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-396af7de-7265-4cd1-aac1-4091312c1dea tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.105499 May 10 14:45:06.623713 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 941/1783] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:06.899057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-1ddff4d7-ba6f-45ec-9bed-20c62cc3c47a req-588b1e72-eeea-48d1-b0cb-205f6cd83d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa87b0b7-2c67-463e-bed9-fba02f1215a8", "name": "network-vif-deleted", "tag": "845dd59d-e311-4268-91b8-d95d89e6b945"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:45:06.913854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1ddff4d7-ba6f-45ec-9bed-20c62cc3c47a req-588b1e72-eeea-48d1-b0cb-205f6cd83d24 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:06.914837 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1ddff4d7-ba6f-45ec-9bed-20c62cc3c47a req-588b1e72-eeea-48d1-b0cb-205f6cd83d24 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:06.926756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-1ddff4d7-ba6f-45ec-9bed-20c62cc3c47a req-588b1e72-eeea-48d1-b0cb-205f6cd83d24 service nova] Creating event network-vif-deleted:845dd59d-e311-4268-91b8-d95d89e6b945 for instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 on hv-cinder-84112 May 10 14:45:06.932556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-1ddff4d7-ba6f-45ec-9bed-20c62cc3c47a req-588b1e72-eeea-48d1-b0cb-205f6cd83d24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037187 May 10 14:45:06.933165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 843/1784] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:45:07.151366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:07.158478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:07.159140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:07.159590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:07.160445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:07.160823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:07.252113 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:07.252800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:07.267729 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:07.268444 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:07.271667 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:07.271667 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:07.302031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:07.302507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:07.303147 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lazy-loading 'fault' on Instance uuid aa87b0b7-2c67-463e-bed9-fba02f1215a8 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:45:07.307927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:07.316935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b88572b6-155d-4830-b7b0-2657b6e47275 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.169621 May 10 14:45:07.317600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 942/1785] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:07 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:07.355133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb4c97543e1452d8e6c8f1564addc76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0e8bf4c69e49d1b4a44905d8c9bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:07.363268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71f89d68-313d-41c0-a7a8-b87f984b96ff tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 200 len: 1332 microversion: 2.1 time: 0.116033 May 10 14:45:07.369118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 844/1786] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:07 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:07.640103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:07.640778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:07.647119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:07.647566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:07.648503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:07.648776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:07.714668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:07.724270 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7a93c288-846b-4813-bd46-96954573aec3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088286 May 10 14:45:07.725310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 943/1787] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:08.335181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:08.335825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:08.343049 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:08.343282 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:08.344057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:08.344492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:08.385362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:08.385963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:08.393144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:08.393595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:08.394412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:08.394850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:08.410043 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 HTTP/1.1 May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:45:08.411787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:45:08.413619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': 'aa87b0b7-2c67-463e-bed9-fba02f1215a8'} May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:45:08.414865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:45:08.416476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:45:08.418042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:45:08.418042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b4d8a37e-d37c-4c55-86b3-2e7176c747e2 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 404 len: 111 microversion: 2.1 time: 0.031758 May 10 14:45:08.418042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 944/1788] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:08 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:45:08.422662 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7b039aee-64fd-4ec4-8210-f01712d3e2ba tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '.version_select at 0x7fef84424f70>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:08.480860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:08.489326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19d8aabf-1668-457c-8c12-d65d72987bda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157997 May 10 14:45:08.489885 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 845/1789] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:08 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:08.518759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7b039aee-64fd-4ec4-8210-f01712d3e2ba tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059098717" status: 202 len: 0 microversion: 2.1 time: 0.100021 May 10 14:45:08.519331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 945/1790] 10.222.0.58 () {58 vars in 1220 bytes} [Tue May 10 14:45:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059098717 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:45:08.744693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:08.745306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:08.756021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:08.756929 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:08.758832 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:08.759288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:08.858312 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:08.866610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-063ea760-410f-4ee1-bcfd-e4d1651a9b53 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.127217 May 10 14:45:08.867183 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 846/1791] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:09.506615 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:09.507238 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:09.515256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:09.515646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:09.516456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:09.516901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:09.646558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:09.654609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01c5ff38-4596-4b1d-84fe-ce57013fec87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151851 May 10 14:45:09.655172 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 946/1792] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:09 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:09.884435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:09.885050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:09.891656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:09.892109 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:09.892898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:09.893337 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:09.957323 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:09.966131 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a78f096a-7846-411f-ad64-128b37732397 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085572 May 10 14:45:09.967121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 847/1793] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:10.672908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:10.673513 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:10.679889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:10.680332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:10.681097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:10.681536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:10.812387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:10.820167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e894d0c2-2cc4-4019-baaa-693a3e41857c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151646 May 10 14:45:10.820747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 947/1794] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:10 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:10.984038 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:10.984590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:10.991185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:10.991634 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:10.992407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:10.992860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:11.065509 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:11.075518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41cf3cb3-2302-4cf5-9766-40fac08ba608 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.095564 May 10 14:45:11.076099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 848/1795] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:11.838366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:11.839202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:11.846166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:11.846656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:11.847448 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:11.847907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:11.985995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:11.996612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ca524187-6b51-4826-9783-ce8c7c753188 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161739 May 10 14:45:11.997708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 948/1796] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:11 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:12.094459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:12.095057 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:12.101413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:12.101863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:12.102675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:12.103116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:12.165886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:12.174003 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-352e9018-85d5-426e-9c8b-2f4a83915f8d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084184 May 10 14:45:12.174608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 849/1797] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:13.015300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:13.016265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:13.022550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:13.023001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:13.023783 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:13.024219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:13.153559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:13.162271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2613cbcf-b06e-404d-84ce-399255c23434 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151032 May 10 14:45:13.162879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 949/1798] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:13 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:13.191770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:13.192373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:13.198802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:13.199251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:13.200020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:13.200447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:13.261956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:13.270339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d20160e-1a52-4fc4-af05-f06f15a8fc8e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083112 May 10 14:45:13.270845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 850/1799] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:14.180234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:14.180852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:14.187748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:14.188194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:14.188952 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:14.189381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:14.291506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:14.292382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:14.299494 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:14.299946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:14.300727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:14.301156 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:14.325249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:14.333306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f2302c6d-73ab-406a-86ae-84bfd0e79e00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156919 May 10 14:45:14.334072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 950/1800] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:14 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:14.364319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:14.372125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0eea7082-b4c0-4fa7-87aa-bde8060914ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088167 May 10 14:45:14.372681 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 851/1801] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:14 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:15.351092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:15.351687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:15.358628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:15.359080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:15.359859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:15.360301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:15.388617 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:15.389317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:15.395846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:15.396299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:15.397076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:15.397511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:15.484441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:15.492706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d34bac6-554f-44c0-8112-bd5358a660fe tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.107914 May 10 14:45:15.493277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 852/1802] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:15.519363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:15.527271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2018ee68-6771-4294-b8cd-7e53eac6df87 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.180112 May 10 14:45:15.527840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 951/1803] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:15 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:16.508792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:16.509422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:16.516411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:16.516845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:16.517602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:16.518030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:16.545441 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:16.546140 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:16.552780 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:16.553240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:16.554859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:16.554859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:16.579940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:16.587951 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d417069a-0a36-4fc5-9218-a46f87eec354 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082960 May 10 14:45:16.588657 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 853/1804] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:16.684726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:16.693741 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e95dfd2-ed3e-482a-838f-11f330cc93da tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152706 May 10 14:45:16.694340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 952/1805] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:16 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:17.605320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:17.605955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:17.613471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:17.613926 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:17.614726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:17.615163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:17.679638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:17.688638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c0a2678-7c46-4d5f-b951-0debc979cf19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087151 May 10 14:45:17.689236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 854/1806] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:17.713154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:17.713762 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:17.720668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:17.721108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:17.721885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:17.722337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:17.864123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:17.877841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a58ec539-1692-470f-8007-5b5c461f24d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.168547 May 10 14:45:17.878461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 953/1807] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:17 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:18.705778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:18.706422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:18.712877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:18.713325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:18.714105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:18.714573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:18.777294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:18.785934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d4b2b28-043b-48cc-8ae1-58edcd6842c4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084045 May 10 14:45:18.786524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 855/1808] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:18.896467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:18.897084 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:18.905868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:18.906685 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:18.908029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:18.908469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:19.038900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:19.046912 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5836f3c0-610a-4a6e-acc3-599f0f6531e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154702 May 10 14:45:19.047501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 954/1809] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:18 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:19.802111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:19.802767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:19.809070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:19.809519 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:19.810979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:19.811439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:19.874430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:19.882505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4774008-06f6-4f8a-b5b8-29c662cb538c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084332 May 10 14:45:19.883074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 856/1810] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:20.063978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:20.064551 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:20.070602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:20.071055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:20.071822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:20.072260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:20.211143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:20.219587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-976674ef-aa08-42c9-a8a8-ebd6190e8efa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159605 May 10 14:45:20.220163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 955/1811] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:20 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:20.898813 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:20.899429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:20.906349 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:20.906806 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:20.907587 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:20.908030 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:20.972814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:20.980939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf4ba214-c2c0-4ea5-b3f4-1be70bd1bba9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086032 May 10 14:45:20.981503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 857/1812] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:21.237727 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:21.238310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:21.244729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:21.245184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:21.245957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:21.246437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:21.377412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:21.385228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e4cc3440-d480-4594-9156-2a1d20865b73 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151941 May 10 14:45:21.385799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 956/1813] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:21 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:21.999330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:21.999981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:22.006547 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:22.006987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:22.007763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:22.008192 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:22.071639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:22.081260 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-05cfef5c-dff8-4b17-b796-6185db52537b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085732 May 10 14:45:22.081839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 858/1814] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:22.403130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:22.406707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:22.411076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:22.411528 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:22.412306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:22.412740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:22.558348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:22.567011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5b43b0a4-64e5-4c91-ab25-18031a9e33ce tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.167821 May 10 14:45:22.567585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 957/1815] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:22 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:23.098738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:23.099280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:23.105632 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:23.106085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:23.107766 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:23.108217 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:23.172166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:23.180383 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca50e03b-6a91-4586-ab5c-8814c10affe0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085608 May 10 14:45:23.180940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 859/1816] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:23.584179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:23.584797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:23.591199 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:23.592189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:23.592979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:23.593538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:23.724233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:23.732334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f607349a-a504-4ece-94d8-d7650161edc3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152085 May 10 14:45:23.732891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 958/1817] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:23 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:24.196958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:24.197555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:24.204432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:24.204880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:24.205658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:24.206085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:24.277974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:24.286261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36bc1381-ef3d-4dbb-a9ef-1ca1300e07f6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.093139 May 10 14:45:24.286906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 860/1818] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:24.748949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:24.749559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:24.755905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:24.756353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:24.757124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:24.757562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:24.886404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:24.894926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ddb063d-be10-45b7-9737-c7bdad567a7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.149848 May 10 14:45:24.895505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 959/1819] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:24 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:25.304022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:25.304631 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:25.311844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:25.312293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:25.313068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:25.313501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:25.375237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:25.383014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ee1cce1-2da6-41ed-9e5e-35ad157d2049 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082897 May 10 14:45:25.383580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 861/1820] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:25.913411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:25.914013 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:25.921034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:25.921488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:25.922867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:25.922867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:26.052903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:26.060944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fac95c2a-2b03-4eda-956d-8ca7ad15d930 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151394 May 10 14:45:26.061508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 960/1821] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:25 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:26.400295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:26.400908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:26.407477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:26.407926 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:26.408698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:26.409132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:26.479763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:26.488955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31ea98ce-cd58-4b82-8490-e1995d1c4567 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.092624 May 10 14:45:26.489526 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 862/1822] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:27.079568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:27.080163 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:27.086792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:27.087246 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:27.088031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:27.088469 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:27.221367 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:27.229652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d9d34f1a-be8d-4113-a18f-fc0f5f69950a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154659 May 10 14:45:27.230260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 961/1823] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:27 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:27.507178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:27.507786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:27.514931 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:27.515382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:27.516165 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:27.516606 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:27.581615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:27.593896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb24664b-3685-4a17-a62d-de4303e2f7e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090518 May 10 14:45:27.594524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 863/1824] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:28.246682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:28.247460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:28.254740 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:28.255198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:28.255981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:28.256425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:28.389376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:28.397561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ed7c8016-c025-487e-ac46-1102f91d5490 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154721 May 10 14:45:28.398363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 962/1825] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:28 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:28.611273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:28.612108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:28.619198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:28.619653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:28.620460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:28.620894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:28.682325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:28.690436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7fced3a7-b56f-4133-a139-7346559c43dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083311 May 10 14:45:28.691018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 864/1826] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:29.415562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:29.416150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:29.424291 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:29.433332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:29.433332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:29.433332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:29.563462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:29.571316 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-80e95a78-5d63-4966-b8b5-add7ecac6106 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.159768 May 10 14:45:29.571883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 963/1827] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:29 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:29.707819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:29.708355 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:29.714782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:29.715239 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:29.716652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:29.717149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:29.782341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:29.790145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1d42e75d-bace-4830-8141-306bb758bbba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086277 May 10 14:45:29.790732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 865/1828] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:30.588836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:30.589455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:30.596378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:30.596825 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:30.597588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:30.598017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:30.728624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:30.737671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07c7ce5b-45b2-4830-a115-102483820514 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152784 May 10 14:45:30.738280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 964/1829] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:30 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:30.810273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:30.810886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:30.817295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:30.817737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:30.818538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:30.818965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:30.883872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:30.892807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d068d15f-faa6-4a77-a73a-49dcf045de7f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086891 May 10 14:45:30.893374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 866/1830] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:31.755506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:31.756104 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:31.763031 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:31.763490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:31.764267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:31.764707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:31.894596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:31.904659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-225be90b-480b-4d12-b573-84a0047aa322 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151759 May 10 14:45:31.904659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 965/1831] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:31 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:31.909412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:31.910064 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:31.916369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:31.916816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:31.917586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:31.918024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:31.980946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:31.989666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4ab1222-0e80-4355-930e-a6f3503bae87 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084071 May 10 14:45:31.990245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 867/1832] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:31 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:32.920738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:32.921336 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:32.927744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:32.928201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:32.928975 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:32.929405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:33.007284 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:33.007284 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:33.014374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:33.014898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:33.015751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:33.016258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:33.071930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:33.080891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3b62849b-f499-4aec-a1e2-024bd2be84f7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.164825 May 10 14:45:33.081472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 966/1833] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:32 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:33.088136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:33.097230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c96a5ac6-634b-437a-9984-ab26f4ebc456 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.094687 May 10 14:45:33.097794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 868/1834] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:33 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:34.099194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:34.099983 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:34.106784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:34.107398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:34.108225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:34.108665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:34.115366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:34.116078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:34.126102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:34.126577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:34.127695 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:34.127846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:34.212846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:34.221940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-469630e2-c51b-48b7-a87d-e5b41e5a9872 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.110674 May 10 14:45:34.222612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 869/1835] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:34.268707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:34.276599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4f6aec0-e91b-4df7-a695-0d85b9a1cca3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.181304 May 10 14:45:34.277174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 967/1836] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:34 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:35.239236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:35.239882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:35.246436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:35.247387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:35.248517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:35.248952 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:35.295609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:35.296239 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:35.302721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:35.303174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:35.303964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:35.304420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:35.319747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:35.331507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b47ed91-2a08-4f29-9fba-b68cd9e38e82 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.096302 May 10 14:45:35.332092 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 870/1837] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:35.444775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:35.452895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b1b7cd0e-3ee7-4f5e-ad22-02a8da7834e3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.161975 May 10 14:45:35.453471 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 968/1838] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:35 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:36.348966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:36.349573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:36.357168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:36.357622 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:36.359816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:36.362090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:36.426450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:36.434886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ef11e24-bcb3-4497-9683-33b6ff41afb6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089150 May 10 14:45:36.435416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 871/1839] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:36 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:36.470427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:36.471038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:36.478925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:36.479377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:36.480156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:36.480592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:36.614867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:36.623141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-72dbfc90-0cf1-45ad-8cf6-675aaba3c9fa tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156988 May 10 14:45:36.623726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 969/1840] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:36 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:37.452042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:37.452822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:37.459149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:37.459603 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:37.460401 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:37.460840 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:37.536481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:37.544906 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1f195fd0-12d0-4668-8cf0-92ad05c54d27 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.096378 May 10 14:45:37.546787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 872/1841] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:37.641440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:37.642077 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:37.648487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:37.648939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:37.649721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:37.650157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:37.798060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:37.806108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3480948-ec7f-45df-a4b8-6fb7c5a34c62 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.169239 May 10 14:45:37.807083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 970/1842] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:37 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:38.561636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:38.562299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:38.568565 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:38.569050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:38.569835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:38.570302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:38.635632 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:38.644376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff350eb4-4fbc-4427-ad56-633c44c6c420 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086835 May 10 14:45:38.644950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 873/1843] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:38.823758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:38.824317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:38.831508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:38.831955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:38.832730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:38.833177 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:38.963777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:38.972556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fc2aae4e-6588-491f-b54a-0700cfd24a35 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.152738 May 10 14:45:38.973148 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 971/1844] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:38 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:39.662144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:39.662803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:39.670055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:39.670534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:39.671313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:39.671745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:39.740745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:39.748302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44018328-2b66-4330-80da-a6f26605630f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089891 May 10 14:45:39.748896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 874/1845] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:39.989300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:39.990024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:39.996468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:39.996946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:39.997735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:39.998171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:40.133990 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:40.142856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48b538de-11a2-4d1e-8770-10ba11bba0a3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.157698 May 10 14:45:40.143818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 972/1846] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:39 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:40.765561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:40.766166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:40.772532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:40.772971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:40.773734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:40.774155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:40.835950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:40.844303 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-02f9ccb9-0daf-4584-9ceb-f37849186d39 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082983 May 10 14:45:40.844871 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 875/1847] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:40 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:41.162730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:41.163352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:41.170480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:41.170920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:41.171693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:41.172130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:41.306986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:41.314860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-91afb8a2-0fed-4db1-81e8-db51b093a390 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.156011 May 10 14:45:41.315424 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 973/1848] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:41 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:41.861237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:41.862079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:41.868699 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:41.869153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:41.869934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:41.870403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:41.933882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:41.942681 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-85f7b0a5-6b1d-403f-b47f-5259f6950c95 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085389 May 10 14:45:41.943246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 876/1849] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:42.332076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:42.335161 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:42.339215 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:42.339660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:42.340713 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:42.341977 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:42.482552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:42.490556 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a50b9a43-7f32-4adb-91ab-1b6269aca263 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.162703 May 10 14:45:42.491122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 974/1850] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:42 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:42.960181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:42.960761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:42.967936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:42.968529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:42.969053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:42.969481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:43.030795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:43.038677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7391d47f-5889-455c-844b-c54fcfd8cf3d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082395 May 10 14:45:43.039237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 877/1851] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:43.507857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:43.508454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:43.515920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:43.516381 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:43.517162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:43.517605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:43.649078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:43.657658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-23f85d7a-3caf-41e0-990d-d5a090532d9a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153722 May 10 14:45:43.658243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 975/1852] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:43 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:44.055286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:44.055889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:44.062865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:44.063309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:44.064071 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:44.064499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:44.126044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:44.133941 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c1f60be-e74f-4900-8afe-70581849ea6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082513 May 10 14:45:44.134559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 878/1853] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:44 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:44.675519 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:44.676146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:44.682735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:44.683183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:44.684007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:44.684442 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:44.810950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:44.818833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0094ae11-61fd-4ea5-b80e-6e7f28d0e1e4 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.147233 May 10 14:45:44.819404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 976/1854] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:44 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:45.151868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:45.152735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:45.159680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:45.160134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:45.160916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:45.161352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:45.226250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:45.234916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4c608a3-fa18-4524-bfd7-2ba90d802dc5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087045 May 10 14:45:45.235498 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 879/1855] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:45.836621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:45.837397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:45.843992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:45.844453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:45.845236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:45.845676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:45.973114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:45.981660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01e9742b-82cc-428b-9695-204a1f16e38e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.148961 May 10 14:45:45.982263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 977/1856] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:45 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:46.252223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:46.252826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:46.259105 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:46.259549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:46.260309 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:46.260737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:46.325607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:46.334430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9be4638-3837-4a73-bafb-06a10fb96b38 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086031 May 10 14:45:46.335033 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 880/1857] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:46 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:46.999668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:47.000220 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:47.006775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:47.007258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:47.007994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:47.008427 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:47.141663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:47.149654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fcc72d57-a224-4eee-87f5-cff0699be80d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.154436 May 10 14:45:47.150243 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 978/1858] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:46 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:47.351579 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:47.489868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:47.489868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:47.489868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:47.489868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:47.490992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:47.490992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:47.490992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c412529d-3298-46f6-89dc-384b2896c024 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087877 May 10 14:45:47.490992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 881/1859] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:47 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:48.167877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:48.168763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:48.175306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:48.175828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:48.176543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:48.176982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:48.305230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:48.314263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c0006a2-69ef-4970-96e4-70e32597341e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150219 May 10 14:45:48.314851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 979/1860] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:48 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:48.453784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:48.454407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:48.460958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:48.461406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:48.462223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:48.462751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:48.531754 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:48.539629 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b0350ee0-26d2-467c-a010-015c41cb5047 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090643 May 10 14:45:48.540190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 882/1861] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:49.332641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:49.333547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:49.341114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:49.341567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:49.342471 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:49.342959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:49.473866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:49.481774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cf6d6b7b-1636-4391-9294-4eddbdb68824 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153810 May 10 14:45:49.482382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 980/1862] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:49 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:49.557006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:49.557612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:49.564801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:49.565235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:49.566006 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:49.566467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:49.631586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:49.640718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7faa0adf-0681-4c21-8dd2-08d802be8cde tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087443 May 10 14:45:49.641308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 883/1863] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:50.499736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:50.500359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:50.506718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:50.507164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:50.507929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:50.508360 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:50.639258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:50.647183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-de670d76-6bd3-4cde-a7b5-81d2b173e3ca tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151633 May 10 14:45:50.647753 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 981/1864] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:50 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:50.657248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:50.657859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:50.664193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:50.664641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:50.665411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:50.665846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:50.726777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:50.734643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bad7bb82-606e-4a94-b1a9-13a54d28bdc3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081672 May 10 14:45:50.735211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 884/1865] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:50 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:51.664458 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:51.665072 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:51.671684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:51.672146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:51.672928 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:51.673374 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:51.751544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:51.752844 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:51.761283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:51.761283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:51.761283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:51.761283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:51.829998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:51.829998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-35145273-61a2-446f-8b34-f4d8c0d80306 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.166943 May 10 14:45:51.829998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 982/1866] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:51 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:51.835901 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:51.843881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-813b33e7-8ef6-4fad-bf83-b6fc21e49d2b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.096268 May 10 14:45:51.844438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 885/1867] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:51 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:52.845294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:52.845898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:52.852184 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:52.852627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:52.853473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:52.853910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:52.860545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:52.866762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:52.867793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:52.868245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:52.869020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:52.869454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:52.952902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:52.960718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9536442-2062-4d54-a1e3-7e655ccb38d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.103941 May 10 14:45:52.961289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 886/1868] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:53.011174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:53.019700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c04c8e53-b62f-4ffc-8c4a-8581ea62ff54 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.178263 May 10 14:45:53.020285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 983/1869] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:52 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:53.977641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:53.978249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:53.985179 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:53.985618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:53.986708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:53.987153 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:54.037048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:54.037769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:54.044412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:54.044866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:54.045642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:54.046085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:54.049353 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:54.057692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cfa4cdbb-afc0-498d-a39b-11969eae6533 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083838 May 10 14:45:54.058362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 887/1870] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:53 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:54.178959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:54.187039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0fc291e2-0d1f-4966-a927-cfcbfaf0db66 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153908 May 10 14:45:54.187903 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 984/1871] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:54 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:55.075056 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:55.075645 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:55.081852 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:55.082329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:55.083106 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:55.083540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:55.144429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:55.152781 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-605a8db6-b715-4edf-bf09-9cdbff452311 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081249 May 10 14:45:55.153484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 888/1872] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:55 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:55.204092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:55.204701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:55.211145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:55.211592 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:55.212352 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:55.212786 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:55.340520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:55.353839 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7575ab57-052f-4eba-abb4-48d4f56c9692 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.153207 May 10 14:45:55.354675 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 985/1873] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:55 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:56.169982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:56.170623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:56.176890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:56.177332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:56.178093 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:56.178545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:56.373180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:56.373785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:56.381955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:56.382462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:56.383268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:56.383704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:56.493478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:56.501819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea6f34af-bb78-4ff9-9dbb-0cf9bb8462a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.335719 May 10 14:45:56.502433 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 889/1874] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:56.586891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:56.595668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d3c17ecc-cafe-453b-98e9-657b5cecb5e7 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.226727 May 10 14:45:56.596236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 986/1875] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:56 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:45:57.518776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:57.519404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:57.525683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:57.526116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:57.526909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:57.527836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:57.587308 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:57.595744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a9f8be6-0f74-4d3d-a2d3-e327834bc6d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.080822 May 10 14:45:57.596311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 890/1876] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:57.612726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:57.613491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:57.619833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:57.620278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:57.621150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:57.621581 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:57.750884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:57.758767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b4cad15e-60d4-4c02-882d-c35429fafceb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.150123 May 10 14:45:57.759338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 987/1877] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:57 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:58.612984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:58.613616 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:58.620285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:58.620878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:58.621655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:58.622085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:58.686523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:58.695471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-705bc110-9fa1-4fc3-a269-908946e9d536 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086500 May 10 14:45:58.696044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 891/1878] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:58.776741 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:58.778085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:58.784627 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:58.785076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:58.785850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:58.786324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:58.916359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:58.924696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d2110461-cfdd-4810-b6a1-7442b270658e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.151799 May 10 14:45:58.925310 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 988/1879] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:58 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:59.713582 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:59.714930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:59.728318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:59.728318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:59.728318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:59.728318 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:59.791480 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:45:59.801221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ca0d1dc-24c0-4d87-8bf2-b544175c7089 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.092287 May 10 14:45:59.801830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 892/1880] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:45:59.945541 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:45:59.946819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:45:59.958040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:59.958810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:45:59.960024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:45:59.960600 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:00.099384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:00.108179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-78ac40a1-9680-4882-bf3d-11513ac84689 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.170207 May 10 14:46:00.113761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 989/1881] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:45:59 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:00.818749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:00.819336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:00.826758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:00.827207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:00.827997 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:00.828396 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:00.925588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:00.936866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c221e93d-79c4-4228-bb27-c4de1a070c33 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.122126 May 10 14:46:00.937613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 893/1882] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:01.125883 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:01.126636 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:01.132775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:01.133224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:01.134021 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:01.134485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:01.302298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:01.310679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46213b38-e3ae-4405-b645-0da89425cb49 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1561 microversion: 2.1 time: 0.189413 May 10 14:46:01.311247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 990/1883] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:01 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:01.472090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-f2fa3c1a-befb-41c2-9fce-085a99aadc62 req-b78dd9b8-7266-42e3-bd71-ec0336ff75ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c342ab3-912f-4596-b007-862a7aa84479", "name": "network-vif-deleted", "tag": "dc933eb9-793c-490d-9d5b-57cee818dbd4"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:46:01.480692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f2fa3c1a-befb-41c2-9fce-085a99aadc62 req-b78dd9b8-7266-42e3-bd71-ec0336ff75ea service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:01.480986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f2fa3c1a-befb-41c2-9fce-085a99aadc62 req-b78dd9b8-7266-42e3-bd71-ec0336ff75ea service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:01.492040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-f2fa3c1a-befb-41c2-9fce-085a99aadc62 req-b78dd9b8-7266-42e3-bd71-ec0336ff75ea service nova] Creating event network-vif-deleted:dc933eb9-793c-490d-9d5b-57cee818dbd4 for instance 9c342ab3-912f-4596-b007-862a7aa84479 on hv-cinder-84112 May 10 14:46:01.497936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-f2fa3c1a-befb-41c2-9fce-085a99aadc62 req-b78dd9b8-7266-42e3-bd71-ec0336ff75ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029429 May 10 14:46:01.498886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 894/1884] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:46:01.954248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:01.954891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:01.960773 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:01.961321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:01.962098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:01.962570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:02.040363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:02.049157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ef29b89b-2026-4cfe-926f-459e56f91358 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.099085 May 10 14:46:02.049746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 991/1885] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:02.328890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:02.329626 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:02.336313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:02.336751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:02.337513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:02.337942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:02.412666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:02.421290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cfe77b64-3944-4bd0-b353-e6046f5eeecb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.097327 May 10 14:46:02.421858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 895/1886] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:02 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:03.066697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:03.067322 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:03.074158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:03.080748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:03.080748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:03.080748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:03.141489 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:03.149262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3bea5ed-9d64-4669-aa12-48ee8939839a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086419 May 10 14:46:03.149891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 992/1887] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:03.439824 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:03.440561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:03.446963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:03.447441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:03.448191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:03.448698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:03.512930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:03.520843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0eb4ad1-82da-4d64-9b6e-58f343a8412d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.085034 May 10 14:46:03.521407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 896/1888] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:03 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:04.166950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:04.167918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:04.174637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:04.175086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:04.175856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:04.176286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:04.238725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:04.247215 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-62561895-2d7c-47eb-828c-c3d121ab4aa6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084221 May 10 14:46:04.247784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 993/1889] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:04.538152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:04.538811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:04.545886 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:04.546385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:04.547143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:04.547602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:04.612809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:04.621655 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f72bf686-ec88-49df-a259-9cb856f0f1b3 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.086541 May 10 14:46:04.622256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 897/1890] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:04 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:05.265093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:05.266044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:05.272490 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:05.272943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:05.273719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:05.274159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:05.335772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:05.344611 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3f8f3ab-e47b-4b86-90d0-5ba679f6d547 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084204 May 10 14:46:05.345167 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 994/1891] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:05.639898 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:05.640495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:05.646902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:05.647380 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:05.648145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:05.648577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:05.711274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:05.719280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-922409fe-3e56-4a2d-9099-b31725e8a086 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083928 May 10 14:46:05.719855 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 898/1892] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:05 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:06.362179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:06.362805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:06.369099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:06.369542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:06.370328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:06.371341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:06.434823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:06.442729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1817a26e-4529-4e00-ba7d-ffdd8dfecce7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084795 May 10 14:46:06.443282 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 995/1893] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:06.736819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:06.737495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:06.744250 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:06.744702 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:06.746130 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:06.746595 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:06.810862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:06.818872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d86dbd3c-6345-4e37-9e84-c4b89ca347ae tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.086109 May 10 14:46:06.819436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 899/1894] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:06 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:07.459485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:07.460085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:07.467144 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:07.467588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:07.468345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:07.468776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:07.529836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:07.537972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-67d40035-976d-4bd0-9f25-3c8a7866b589 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082401 May 10 14:46:07.538576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 996/1895] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:07.835882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:07.836504 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:07.843414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:07.843889 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:07.844654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:07.845081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:07.905783 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:07.913640 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab9ea60f-5e28-4f6f-80d5-a0e533815253 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.081602 May 10 14:46:07.914224 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 900/1896] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:07 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:08.554307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:08.554851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:08.561960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:08.562456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:08.563237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:08.563687 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:08.624598 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:08.632402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b8d56619-8058-49f5-8c1d-d8a2a493ec5e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082110 May 10 14:46:08.632969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 997/1897] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:08.930778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:08.931382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:08.938023 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:08.938509 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:08.939273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:08.939698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:09.003692 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:09.012187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fef2f89a-87c5-42ed-b793-521e5f6eef8b tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.085277 May 10 14:46:09.012755 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 901/1898] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:08 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:09.648799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:09.649405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:09.656300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:09.656809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:09.657569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:09.658004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:09.720840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:09.729571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0155621a-1a6d-40d6-bfd4-26423f688170 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084569 May 10 14:46:09.730473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 998/1899] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:10.029601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:10.030396 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:10.038403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:10.038856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:10.039757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:10.040201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:10.103907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:10.113132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab3b5ef6-d497-46a2-8476-2bbb50c53fe6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.087846 May 10 14:46:10.114027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 902/1900] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:10 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:10.747166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:10.747798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:10.754107 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:10.754642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:10.755403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:10.755833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:10.817574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:10.826261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ff6d47c-3ca6-4918-9432-2b2931f10436 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082989 May 10 14:46:10.826832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 999/1901] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:11.130969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:11.131578 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:11.138671 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:11.141690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:11.141690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:11.141690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:11.203441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:11.211541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6f1d143-1c29-4cb7-b154-58b4e6b9ba83 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084376 May 10 14:46:11.212790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 903/1902] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:11 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:11.844498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:11.845036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:11.851025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:11.851474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:11.852248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:11.852686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:11.919317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:11.927185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20019259-7e64-4362-b9f3-b513ea547bab tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088053 May 10 14:46:11.927764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1000/1903] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:11 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:12.228567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:12.229149 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:12.235826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:12.236270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:12.237304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:12.237737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:12.311005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:12.318972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-908a8b77-e799-4346-bb98-05c878d408a1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.094328 May 10 14:46:12.319604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 904/1904] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:12 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:12.944062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:12.944680 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:12.951543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:12.951992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:12.952759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:12.953194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:13.015232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:13.023127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-78395548-c6b9-4802-9531-59e702bd3808 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082976 May 10 14:46:13.023699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1001/1905] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:13.336256 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:13.336818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:13.344002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:13.344454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:13.345225 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:13.345658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:13.411005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:13.420037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d524cbb-7e6e-477a-9905-6b353792b1dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.087670 May 10 14:46:13.420605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 905/1906] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:13 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:14.041018 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:14.041656 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:14.049438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:14.051000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:14.051000 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:14.051211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:14.117097 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:14.126088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1484cee2-3483-4e24-ae4c-759a3a8d7b65 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089248 May 10 14:46:14.126697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1002/1907] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:14 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:14.437523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:14.438116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:14.444420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:14.444865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:14.445621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:14.446050 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:14.507863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:14.516683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a89016b3-94f9-4563-adf5-204761659799 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083018 May 10 14:46:14.517240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 906/1908] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:14 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:15.143117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:15.143761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:15.150061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:15.150550 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:15.151822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:15.152554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:15.212888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:15.221708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6004881c-2327-44cf-94c0-9f0c3c449898 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082603 May 10 14:46:15.222294 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1003/1909] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:15.533548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:15.534116 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:15.540836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:15.541280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:15.542144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:15.542787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:15.606841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:15.615212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7a693d8-ce10-48e1-99fd-ed42e866c496 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.085552 May 10 14:46:15.615775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 907/1910] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:15 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:16.239700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:16.240334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:16.247481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:16.247935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:16.248700 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:16.249137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:16.309874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:16.317781 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f96da637-0aa7-43d7-a94e-bae5ad163a11 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082210 May 10 14:46:16.318382 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1004/1911] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:16.632207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:16.632807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:16.639120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:16.639561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:16.640319 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:16.640749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:16.700834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:16.708675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c6c538e-021b-4162-90c0-fa8d9a6ad5cd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.080310 May 10 14:46:16.709235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 908/1912] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:16 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:17.335098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:17.335791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:17.342728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:17.343181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:17.343953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:17.344394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:17.405261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:17.413001 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-74908274-8f15-4d51-b000-7cc7f11ad0ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081778 May 10 14:46:17.413565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1005/1913] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:17.725437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:17.726068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:17.732759 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:17.733487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:17.734281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:17.734714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:17.797945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:17.805677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3dd7532-e5f1-4175-92ac-8c37cab98173 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084166 May 10 14:46:17.806248 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 909/1914] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:17 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:46:18.430791 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:18.431434 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:18.438426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:18.438880 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:18.439646 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:18.440088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:18.500893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:18.508713 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73a960f1-5d4e-4e9b-9107-cb7d82b00b64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081794 May 10 14:46:18.509309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1006/1915] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:18.822908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:18.823676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:18.830287 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:18.830738 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:18.831515 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:18.831946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:18.898385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:18.906985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-98e7a1c4-5d93-4480-b7a2-9e60c1f745a9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.088062 May 10 14:46:18.907544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 910/1916] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:18 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:19.527487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:19.528095 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:19.534276 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:19.534752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:19.535508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:19.535935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:19.597363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:19.605691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-456dc0e5-b659-4009-850e-e8a1306ee068 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083043 May 10 14:46:19.606265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1007/1917] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:19.924090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:19.924688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:19.931194 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:19.931648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:19.939965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:19.940409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:20.012314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:20.020168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20546ed3-d219-4309-a55d-d8c099278898 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.099988 May 10 14:46:20.020720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 911/1918] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:19 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:20.623575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:20.624226 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:20.630817 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:20.631272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:20.632051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:20.632493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:20.695932 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:20.703976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7d9686dc-9146-4b0c-90cd-a59fa851d3f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084987 May 10 14:46:20.704754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1008/1919] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:21.037761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:21.038397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:21.045588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:21.046045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:21.046864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:21.047305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:21.107919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:21.116112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91628870-219d-44ed-bdd3-035af9925a0d tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.082254 May 10 14:46:21.116688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 912/1920] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:21 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:21.720938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:21.721663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:21.728079 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:21.728536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:21.729384 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:21.730033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:21.791365 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:21.799483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-24b10136-841f-4c08-a295-36f59a10e202 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082475 May 10 14:46:21.800052 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1009/1921] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:22.133146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:22.133750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:22.141108 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:22.141568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:22.142336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:22.142762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:22.208341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:22.216329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78fd2a0c-e6ed-46b3-a7b3-8858b7008cda tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.087057 May 10 14:46:22.216862 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 913/1922] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:22 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:22.817011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:22.817624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:22.824939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:22.825470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:22.826265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:22.826701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:22.896557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:22.900866 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d1d14924-67c2-43e3-b5e8-40caa329edfd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087728 May 10 14:46:22.902756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1010/1923] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:22 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:23.235641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:23.236210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:23.242956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:23.243404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:23.244172 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:23.244822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:23.306407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:23.315367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-99ae4b68-0552-4055-a54f-3a176659c430 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.085837 May 10 14:46:23.315930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 914/1924] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:23 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:23.918307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:23.918925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:23.925317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:23.925771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:23.926575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:23.927059 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:23.988083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:23.996729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d36cf4b9-c0fb-4b7b-813b-2c9b29c60158 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083013 May 10 14:46:23.997302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1011/1925] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:24.333637 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:24.334187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:24.341190 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:24.341633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:24.342429 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:24.342861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:24.406636 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:24.414359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c1ec6e47-3b90-4b88-973d-f28c689e2d7e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084718 May 10 14:46:24.414920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 915/1926] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:24 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:25.014945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:25.015511 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:25.021863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:25.022344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:25.023115 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:25.023555 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:25.084281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:25.092331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f454af5f-e8ff-4ce7-99bc-149c97dc253d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082169 May 10 14:46:25.092897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1012/1927] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:25.431722 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:25.433111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:25.439314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:25.439765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:25.440534 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:25.440969 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:25.501418 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:25.509134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c81bb3be-7809-4a06-8932-77f2ce5c89c9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.081342 May 10 14:46:25.509698 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 916/1928] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:25 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:26.109030 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:26.109588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:26.116229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:26.116712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:26.117485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:26.117929 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:26.180058 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:26.187948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-65096fab-9e39-4fd7-903e-9211625180f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082927 May 10 14:46:26.188513 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1013/1929] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:46:26.526360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:26.527016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:26.533304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:26.533743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:26.534557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:26.534987 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:26.598689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:26.606746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4e7dc7f9-b113-4334-a250-1df3925dad00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084478 May 10 14:46:26.607302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 917/1930] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:26 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:27.204874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:27.205492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:27.211889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:27.212343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:27.213692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:27.214418 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:27.277558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:27.285406 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4926388c-77af-4e9c-8506-d5ee66115601 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084437 May 10 14:46:27.285979 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1014/1931] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:27.624436 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:27.625042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:27.631409 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:27.631866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:27.632627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:27.633058 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:27.695152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:27.703532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31e91b84-e0c7-4088-90c1-86e0e37f20cf tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.082936 May 10 14:46:27.704097 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 918/1932] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:27 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:28.303175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:28.303947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:28.310881 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:28.311328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:28.312090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:28.312520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:28.374285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:28.382928 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-82151b2a-b16b-442a-9eeb-d165f64218c3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083827 May 10 14:46:28.383587 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1015/1933] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:28.720556 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:28.721166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:28.727483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:28.727957 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:28.728833 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:28.729293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:28.792652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:28.800434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8adcdc14-0368-45da-8d46-717deca13c4c tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083694 May 10 14:46:28.800999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 919/1934] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:28 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:29.400553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:29.403116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:29.408201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:29.408644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:29.409417 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:29.409846 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:29.475269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:29.483285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b5c9a099-c7ee-44be-b809-e67230a4bf20 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086657 May 10 14:46:29.483850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1016/1935] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:29.817947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:29.818718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:29.825088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:29.825532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:29.826332 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:29.826767 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:29.891313 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:29.899502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-071ac469-48bb-4113-8761-9380d9bdb7e9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.085375 May 10 14:46:29.900119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 920/1936] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:29 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:30.500507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:30.501109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:30.507504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:30.507956 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:30.508709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:30.509141 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:30.569113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:30.577507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d452406c-46bb-401c-b350-2a694041b7d8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.080880 May 10 14:46:30.578074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1017/1937] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:30.917511 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:30.918112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:30.924384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:30.924825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:30.925583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:30.926007 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:30.991500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:31.000005 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86d60638-1b04-4a9b-adf1-d65d6a56d418 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.087173 May 10 14:46:31.000558 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 921/1938] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:30 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:31.595442 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:31.596093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:31.602497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:31.602953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:31.604320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:31.604760 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:31.664608 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:31.673085 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1b174947-e1a6-4978-8903-8e78e6b328ca tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081473 May 10 14:46:31.673652 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1018/1939] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:31 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:32.016792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:32.017422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:32.023735 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:32.024181 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:32.024937 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:32.025919 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:32.087140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:32.095963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-07e426da-b030-40e9-acbb-07bd51a24663 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.082981 May 10 14:46:32.096533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 922/1940] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:32 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:32.689216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:32.689807 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:32.696376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:32.696821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:32.698370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:32.698792 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:32.762045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:32.769874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bd2167ea-39fd-4e2e-b3ad-36332ed03b19 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084570 May 10 14:46:32.770487 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1019/1941] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:33.114269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:33.114826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:33.122055 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:33.122525 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:33.123284 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:33.123711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:33.188651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:33.196795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-105cc047-e24f-4695-a03e-d310314ee9dc tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.086716 May 10 14:46:33.197445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 923/1942] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:33 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:33.786232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:33.786840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:33.793973 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:33.794451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:33.795208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:33.795640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:33.855642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:33.863865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e53d82ef-f67a-42a3-882c-679454972f3b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081565 May 10 14:46:33.864452 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1020/1943] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:33 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:34.213512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:34.214227 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:34.220205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:34.220649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:34.221404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:34.221834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:34.285529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:34.293325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29182cf5-9d0f-4788-bb16-546dff504733 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084361 May 10 14:46:34.293893 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 924/1944] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:34 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:34.880647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:34.881272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:34.887782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:34.888236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:34.889019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:34.889459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:34.952313 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:34.960236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b0c0a322-ca8c-4518-8982-913c7493c55f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083528 May 10 14:46:34.960819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1021/1945] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:35.311119 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:35.311677 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:35.317571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:35.318017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:35.318814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:35.319245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:35.384045 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:35.393779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d0bae38-03a9-4e45-bfe9-4f84051fe54a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.087276 May 10 14:46:35.394370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 925/1946] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:35 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:35.985069 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:35.985665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:35.992280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:35.992724 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:35.993481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:35.994446 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:36.063411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:36.071512 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fcd354fb-38ec-4398-998a-30b54b1bd76a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090297 May 10 14:46:36.072113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1022/1947] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:36.412660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:36.413255 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:36.420706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:36.421175 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:36.421936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:36.422393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:36.483205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:36.491185 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5001abd5-99c1-4269-9996-62df4706e339 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.082511 May 10 14:46:36.491734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 926/1948] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:36 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:37.090029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:37.090628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:37.096923 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:37.097369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:37.098130 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:37.098588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:37.159402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:37.168119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e96003e-9510-4c26-b9c8-ea25401d1f8f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082838 May 10 14:46:37.168678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1023/1949] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:37.509244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:37.509887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:37.516191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:37.516633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:37.517390 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:37.517816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:37.580500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:37.588794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bbc082b0-ae48-4e96-b8ca-1a5b6b0b42c5 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083406 May 10 14:46:37.589342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 927/1950] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:37 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:38.185719 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:38.192224 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:38.194048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:38.194523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:38.195330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:38.195790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:38.257973 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:38.266972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-68f77ff1-e9bd-49a5-be4e-1294487b0fe7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085831 May 10 14:46:38.267564 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1024/1951] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:38.606413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:38.607017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:38.613548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:38.613993 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:38.614792 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:38.615227 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:38.675155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:38.683566 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-768c4077-7498-4573-949e-886483d5be3a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.081661 May 10 14:46:38.684131 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 928/1952] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:38 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:39.284017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:39.284640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:39.291493 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:39.291948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:39.292714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:39.293147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:39.354545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:39.362560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8467e984-7a3e-4ad1-864e-98a8d4cce44a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082418 May 10 14:46:39.363065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1025/1953] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:39.700923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:39.701536 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:39.708040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:39.708492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:39.709273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:39.709712 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:39.774924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:39.782946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a486ca1f-cd93-4812-8114-9394942e5575 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.086413 May 10 14:46:39.783892 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 929/1954] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:39 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:40.379899 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:40.380560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:40.386874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:40.387318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:40.388080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:40.388508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:40.449277 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:40.456858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-959bb788-b69e-4ca4-81c1-a8a61acfb285 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.080849 May 10 14:46:40.457414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1026/1955] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:40 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:40.800283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:40.800883 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:40.808240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:40.808678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:40.809437 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:40.809865 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:40.873470 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:40.881219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-93690c37-d42a-4101-be0f-5500a8f9d026 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084827 May 10 14:46:40.881777 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 930/1956] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:40 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:41.474147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:41.474782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:41.481851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:41.482338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:41.483108 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:41.483546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:41.546061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:41.553694 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46a1c216-e325-4f51-b685-0b7f462f5ae7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083494 May 10 14:46:41.554274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1027/1957] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:41.898151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:41.898853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:41.905522 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:41.905965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:41.906769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:41.907197 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:42.139477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:42.147328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-66ac85d0-3eb8-45b9-870e-ace64a1871d9 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.252973 May 10 14:46:42.147890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 931/1958] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:41 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:42.571264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:42.572053 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:42.578542 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:42.578995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:42.579768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:42.580208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:42.641124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:42.649349 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8996746a-819a-4f6e-992a-0a9f7633549f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083266 May 10 14:46:42.650437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1028/1959] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:43.164521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:43.165118 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:43.171574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:43.172021 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:43.172790 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:43.173223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:43.233598 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:43.241705 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4689b4c-356c-4d27-a290-5e29c565a97a tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.081209 May 10 14:46:43.242273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 932/1960] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:43 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:43.667878 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:43.668483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:43.674965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:43.675426 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:43.677283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:43.677283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:43.739023 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:43.747664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f8355e81-db3c-49e0-9dbd-7acce5b1ffae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084432 May 10 14:46:43.748229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1029/1961] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:43 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:44.260393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:44.261034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:44.267449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:44.267902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:44.268676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:44.269114 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:44.332037 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:44.340567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7c035ef-e83e-463c-8724-5823718aad99 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084215 May 10 14:46:44.341126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 933/1962] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:44 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:44.765485 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:44.766116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:44.772476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:44.772923 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:44.773673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:44.774103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:44.834884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:44.842696 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f23b035a-78ef-4019-96a6-335ecaa07df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081038 May 10 14:46:44.843263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1030/1963] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:44 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:45.357358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:45.357961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:45.365017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:45.365463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:45.366438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:45.366998 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:45.427960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:45.436749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b43715ae-e1ff-406f-9908-63519cfefe00 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083816 May 10 14:46:45.437303 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 934/1964] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:45 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:45.859756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:45.860362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:45.866960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:45.867413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:45.868179 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:45.869300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:45.928982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:45.937465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-da6141fa-f9b4-46ec-86ba-309d85ca2985 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081573 May 10 14:46:45.938034 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1031/1965] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:46.453121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:46.453742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:46.460076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:46.460521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:46.461280 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:46.461716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:46.525219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:46.532970 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96a9e4f1-17c7-4b7f-bc9c-ccfc6ee5e991 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083940 May 10 14:46:46.533535 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 935/1966] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:46 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:46.954247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:46.955585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:46.961972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:46.962581 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:46.963400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:46.963829 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:47.025729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:47.033713 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a284a90e-4568-4eed-a28b-70ce475e1f64 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083383 May 10 14:46:47.034299 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1032/1967] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:46 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:47.550545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:47.551171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:47.558305 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:47.558752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:47.559516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:47.559949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:47.620533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:47.628428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0a7fa917-048d-4282-be91-e65003329cdd tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.081819 May 10 14:46:47.628986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 936/1968] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:47 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:48.051038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:48.051638 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:48.058676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:48.059124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:48.059891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:48.060327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:48.123394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:48.131159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f15bf9c8-a6a4-408a-a155-64f408eb2305 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084044 May 10 14:46:48.131739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1033/1969] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:48.645602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:48.646220 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:48.653215 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:48.653669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:48.654481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:48.654920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:48.719329 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:48.727371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adf9db8d-cd89-4f45-8010-9dcf3f49e4a0 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.085639 May 10 14:46:48.728514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 937/1970] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:48 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:46:49.148119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:49.148763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:49.157273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:49.157718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:49.158539 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:49.159015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:49.226882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:49.235148 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-024150db-9185-40b4-ac30-626dbedc0ec7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.091111 May 10 14:46:49.235702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1034/1971] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:49.745793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:49.746445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:49.752923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:49.753376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:49.754154 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:49.754618 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:49.815746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:49.824242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-170ed3aa-8003-4122-bfd0-1e71f6302598 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083060 May 10 14:46:49.824843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 938/1972] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:49 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:50.252323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:50.252927 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:50.259477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:50.259997 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:50.260831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:50.261322 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:50.321925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:50.329944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e5b83aa-d983-4582-a478-f6dbe6d5710c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081546 May 10 14:46:50.330545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1035/1973] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:50 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:50.841747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:50.842382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:50.849074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:50.849516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:50.850364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:50.851146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:50.919831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:50.927654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f32d9fae-86ea-4515-b1ae-d8eb3dd60cd2 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.089808 May 10 14:46:50.928205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 939/1974] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:50 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:51.347451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:51.348204 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:51.354545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:51.354995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:51.355774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:51.356214 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:51.417306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:51.425059 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e8a59f6b-1adf-4498-bacf-462f3087f926 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081525 May 10 14:46:51.425634 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1036/1975] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:51 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:51.944516 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:51.945157 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:51.951770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:51.952251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:51.953025 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:51.953460 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:52.017229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:52.025414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f9d5203-e0d3-4565-9c2d-9288f8da07fb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.084704 May 10 14:46:52.025985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 940/1976] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:51 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:52.441894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:52.442548 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:52.449090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:52.449532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:52.450320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:52.450750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:52.511954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:52.520596 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c5a06f05-29fe-41df-96f4-de8d3a77759b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082521 May 10 14:46:52.521171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1037/1977] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:46:53.042705 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:53.043270 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:53.049488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:53.049950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:53.050744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:53.051184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:53.115044 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:53.123796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8af63e1-16d8-4ef8-b5cc-108edae5d641 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.085114 May 10 14:46:53.124371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 941/1978] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:53 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:46:53.538722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:53.539337 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:53.546534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:53.546994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:53.547768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:53.548207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:53.609943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:53.618757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f5d8ee6-0d1d-4c91-ab72-4d54006e12aa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083340 May 10 14:46:53.619509 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1038/1979] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:53 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:54.140688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:54.141310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:54.147686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:54.148141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:54.148932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:54.149373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:54.210035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:54.218164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad771186-e771-4e7e-88b2-24447be5dea6 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.081362 May 10 14:46:54.218750 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 942/1980] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:54 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:54.635603 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:54.636211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:54.642665 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:54.643113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:54.643919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:54.644354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:54.705096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:54.713506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6583d1f-5e70-4b07-8ccc-c1956893cd60 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081823 May 10 14:46:54.714092 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1039/1981] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:54 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:55.235973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:55.236846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:55.244029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:55.244475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:55.245281 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:55.245736 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:55.312251 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:55.320207 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aef7856e-e62e-4140-8cc8-0674141967b1 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.088183 May 10 14:46:55.320762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 943/1982] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:55 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:55.731257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:55.731870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:55.738536 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:55.738991 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:55.739763 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:55.740197 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:55.805950 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:55.814793 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a775ed60-3e3c-4874-ba7b-4f2237a1c10c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088303 May 10 14:46:55.815362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1040/1983] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:55 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:56.339269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:56.339867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:56.346215 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:56.346687 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:56.347446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:56.347876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:56.408725 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:56.417152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52264beb-f8d8-46fd-b0d0-bdd8f612da60 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.082813 May 10 14:46:56.417705 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 944/1984] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:56 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:56.831986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:56.832582 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:56.839606 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:56.840054 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:56.840822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:56.841257 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:56.906010 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:56.913936 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-327e961c-cd2c-4714-8556-85a5f73cbe22 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085873 May 10 14:46:56.914537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1041/1985] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:57.434817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:57.435453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:57.441947 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:57.442445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:57.443244 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:57.443678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:57.509546 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:57.517826 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a2dbe3f-8281-4d45-bcc2-f9144466f29f tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.087233 May 10 14:46:57.518532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 945/1986] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:57 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:57.932348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:57.932955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:57.939281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:57.939729 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:57.940497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:57.940935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:58.003526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:58.011532 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-80ce31a5-b6e1-4900-bc2e-a7440f4c4925 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083841 May 10 14:46:58.012100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1042/1987] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:58.536042 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:58.536653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:58.544085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:58.544747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:58.545412 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:58.545843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:58.607622 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:58.615726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-319b7b00-b82d-4bef-93d2-6630a351ea2e tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.083829 May 10 14:46:58.616291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 946/1988] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:58 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:59.028576 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:59.029190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:59.035574 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:59.036024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:59.036802 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:59.037236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:59.097886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:59.106230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-18b29129-6d85-4ea2-b572-463847c6cf56 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081692 May 10 14:46:59.106811 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1043/1989] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:46:59.632764 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:46:59.633872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:46:59.640297 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:59.640752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:59.641533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:46:59.641974 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:46:59.706086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:46:59.714939 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a8eeb63d-451c-4523-a66f-26d6153d5dcb tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.086588 May 10 14:46:59.715500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 947/1990] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:46:59 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:00.127150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:00.128521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:00.138736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:00.139190 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:00.140314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:00.140758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:00.475916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:00.484660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ca5edb1-6f7b-4897-a171-0c151872d65d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.363555 May 10 14:47:00.485230 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1044/1991] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:00.732615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:00.733150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:00.740200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:00.740652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:00.741432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:00.741867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:00.963531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:00.971845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91eb6290-3640-46a2-b403-5b22c6a5bcf8 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.243735 May 10 14:47:00.972714 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 948/1992] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:00 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:47:01.503339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:01.503962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:01.510510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:01.510968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:01.511757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:01.512200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:01.626478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:01.635206 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c5e02b7-5866-47bb-b8a0-0a358fb0c8d4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.135807 May 10 14:47:01.635778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1045/1993] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:01.988867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:01.989465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] [instance: 9c342ab3-912f-4596-b007-862a7aa84479] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:01.996475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:01.997112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:01.997944 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:01.998405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:02.058817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48efa16cb9844fcd853f1e3760619a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709b9712f09a42a785d046e0c0f3846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:02.066656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17bbef00-ef96-47e2-8656-197f72bf5d46 tempest-VolumesSnapshotTestJSON-1071485369 tempest-VolumesSnapshotTestJSON-1071485369-project] 10.222.0.58 "GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479" status: 200 len: 1350 microversion: 2.1 time: 0.081893 May 10 14:47:02.067243 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 949/1994] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:01 2022] GET /compute/v2.1/servers/9c342ab3-912f-4596-b007-862a7aa84479 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:02.652553 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:02.653160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:02.659711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:02.660171 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:02.660958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:02.661398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:02.730279 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:02.738704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-157aa912-e6c1-41aa-a9a7-1c0cb3685fb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090293 May 10 14:47:02.739286 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1046/1995] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:02 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:03.756733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:03.757341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:03.764487 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:03.764936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:03.765700 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:03.766135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:03.828403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:03.837126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a745a97a-b9df-4c0e-b9fb-59512bae9133 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083797 May 10 14:47:03.837689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 950/1996] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:04.854186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:04.854901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:04.861798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:04.862284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:04.863064 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:04.863503 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:04.927673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:04.936035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-38fdf2f1-ffd7-47a1-8633-fe96d48e3416 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085903 May 10 14:47:04.936806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1047/1997] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:05.953040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:05.953650 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:05.960023 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:05.960475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:05.961751 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:05.962152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:06.023449 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:06.031572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5aeae319-1846-4066-9043-85e87a0d3f7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082574 May 10 14:47:06.032136 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 951/1998] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:07.049691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:07.050308 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:07.057015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:07.057462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:07.058231 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:07.058668 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:07.120771 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:07.128882 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55f557d5-0c29-44e1-9967-77026b4cef3c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083531 May 10 14:47:07.129477 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1048/1999] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:08.146708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:08.147503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:08.154481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:08.154933 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:08.155710 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:08.156145 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:08.220582 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:08.229923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8574fe43-6b8f-48d8-96e4-331e58d1c704 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087081 May 10 14:47:08.230564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 952/2000] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:09.248798 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:09.249405 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:09.256280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:09.256731 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:09.257491 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:09.257958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:09.321090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:09.328961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e95f3cdb-8f40-476a-91ae-8a3cdcdfec1d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084116 May 10 14:47:09.329527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1049/2001] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:10.346703 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:10.347314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:10.353935 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:10.354428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:10.355206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:10.355642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:10.426541 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:10.439521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d8cf8de-3b05-4862-85ed-b41e8bf490ed tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.097216 May 10 14:47:10.440112 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 953/2002] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:11.457679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:11.458244 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:11.465296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:11.465743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:11.466545 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:11.466972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:11.528164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:11.536027 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-131cc3f7-1409-49fb-9b73-9f3476a508e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082443 May 10 14:47:11.536602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1050/2003] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:11 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:12.552331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:12.552955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:12.559932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:12.560385 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:12.561179 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:12.561613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:12.693625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:12.693625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff8e7f11-87b1-4b3b-97f8-cf67f3825c81 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.092658 May 10 14:47:12.693625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 954/2004] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:13.658534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:13.659153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:13.666307 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:13.666758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:13.667524 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:13.667960 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:13.728821 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:13.736902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0e4ada9e-b247-4671-a8b9-118c973ba519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082201 May 10 14:47:13.737474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1051/2005] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:14.754472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:14.755101 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:14.762444 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:14.762887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:14.763649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:14.764085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:14.824193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:14.831989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a99ab31-b288-4e45-a279-033577ee7572 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081438 May 10 14:47:14.832544 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 955/2006] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:14 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:15.848508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:15.849062 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:15.856414 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:15.859691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:15.859691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:15.859691 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:15.919868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:15.927644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4134f78-a47d-458c-bbdb-1448087425b9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083099 May 10 14:47:15.928242 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1052/2007] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:16.944184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:16.945343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:16.952035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:16.952489 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:16.953269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:16.953708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:17.021142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:17.029152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-af1e1edb-65a1-4287-ad27-0b79dc84180a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088992 May 10 14:47:17.029711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 956/2008] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:18.045947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:18.046569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:18.052894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:18.053348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:18.054260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:18.054868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:18.117046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:18.125173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b1ca400b-78e6-48a5-a124-a291001a23d2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083228 May 10 14:47:18.125724 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1053/2009] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:19.142506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:19.143126 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:19.149671 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:19.150125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:19.150928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:19.151371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:19.212111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:19.220061 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7bf515d5-eace-4f91-84bc-4a4e1815cc2c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081483 May 10 14:47:19.220617 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 957/2010] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:20.237331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:20.237963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:20.244894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:20.245343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:20.246111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:20.246577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:20.306923 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:20.314693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f0ecdf9a-3d18-4406-8614-8ff583039c6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081686 May 10 14:47:20.315260 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1054/2011] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:21.332768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:21.333397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:21.339961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:21.340408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:21.341212 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:21.341642 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:21.405079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:21.412909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c76e81c8-9745-4503-a683-25acc6d36f36 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084035 May 10 14:47:21.413973 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 958/2012] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:47:22.432534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:22.433166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:22.439505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:22.439964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:22.440725 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:22.441160 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:22.502589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:22.511408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f11a6cb2-a823-4eef-8349-9e98a5eec5dd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083370 May 10 14:47:22.511981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1055/2013] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:22 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:23.528320 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:23.528921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:23.535354 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:23.535811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:23.536593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:23.537032 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:23.598799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:23.607528 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c6cb96a-113a-4035-9778-ee460b068d83 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083075 May 10 14:47:23.608098 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 959/2014] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:24.624775 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:24.625377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:24.631715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:24.632747 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:24.633502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:24.633930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:24.695275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:24.702947 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bb9a09e5-e920-4f37-ab0f-b691045734b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081965 May 10 14:47:24.703518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1056/2015] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:25.719935 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:25.720576 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:25.727036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:25.727484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:25.728255 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:25.728691 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:25.791744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:25.799573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-633bafc2-2e1e-4a53-ade4-97af06435ee5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083577 May 10 14:47:25.800138 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 960/2016] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:26.817276 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:26.817915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:26.824494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:26.824946 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:26.825715 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:26.826153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:26.889083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:26.897345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-72140d7d-ff93-435a-ad89-e479e66020a3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084592 May 10 14:47:26.898423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1057/2017] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:27.914713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:27.915314 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:27.921628 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:27.922110 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:27.922890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:27.923327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:27.984356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:27.992406 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fdbdf300-fe16-492f-a23b-99480c1126ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081573 May 10 14:47:27.992965 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 961/2018] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:29.009898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:29.010488 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:29.017143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:29.017599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:29.018413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:29.018854 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:29.079402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:29.087534 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-90b739d0-94f3-463b-8f3f-68dded200b6a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082465 May 10 14:47:29.088091 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1058/2019] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:30.105013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:30.105628 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:30.112327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:30.112809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:30.113583 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:30.114020 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:30.177549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:30.185752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-553711bd-3e1c-4102-88f7-9778422fe65c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085401 May 10 14:47:30.186348 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 962/2020] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:31.203150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:31.203874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:31.209988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:31.210465 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:31.211255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:31.211684 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:31.272182 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:31.280526 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f0bbb75d-b815-4588-a1e0-7c0f1bd67619 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081269 May 10 14:47:31.281087 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1059/2021] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:31 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:32.297419 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:32.298028 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:32.305091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:32.305542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:32.306346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:32.306795 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:32.371304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:32.379327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-755f7021-f7a5-4dd8-ba9e-e9afc691326d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085866 May 10 14:47:32.379885 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 963/2022] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:33.396211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:33.396961 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:33.404264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:33.404716 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:33.405479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:33.405917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:33.469342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:33.477241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a7a6a498-03fb-4a5f-a2be-ecd445af3773 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084935 May 10 14:47:33.477810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1060/2023] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:33 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:34.494456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:34.495080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:34.501164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:34.501612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:34.502426 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:34.502867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:34.565701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:34.574948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb888fce-6733-495b-8f35-5b7c9ff940b0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084484 May 10 14:47:34.575524 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 964/2024] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:35.594492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:35.595133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:35.606410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:35.607274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:35.608136 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:35.608579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:35.672203 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:35.680756 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-16ff0f53-6ab2-4276-8199-b3b894758165 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.092415 May 10 14:47:35.681543 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1061/2025] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:36.698142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:36.698758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:36.705245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:36.705693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:36.706496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:36.706924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:36.769727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:36.777664 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-023c916c-4857-4730-b232-7d35d0e198f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084139 May 10 14:47:36.778240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 965/2026] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:36 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:37.794602 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:37.795219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:37.801578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:37.802032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:37.802828 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:37.803824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:37.863931 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:37.872339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba6bb336-7dda-44f7-b5ad-7e51e1967c42 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081553 May 10 14:47:37.872894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1062/2027] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:38.888934 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:38.889581 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:38.895911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:38.896362 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:38.897771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:38.898416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:38.962731 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:38.970667 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7dd71586-dfad-401a-a185-ed863455f382 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085496 May 10 14:47:38.971200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 966/2028] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:39.988492 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:39.989119 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:39.996189 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:39.996676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:39.997583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:39.998019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:40.059964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:40.067999 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5c9e6525-3eee-48ba-a015-fe07c6159f6d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083729 May 10 14:47:40.069090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1063/2029] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:41.086603 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:41.087173 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:41.093425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:41.093877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:41.094680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:41.095123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:41.157363 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:41.165955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d3bcd2b-e301-469f-b64b-b2aa76d0b72b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084056 May 10 14:47:41.166557 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 967/2030] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:42.183351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:42.183954 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:42.190359 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:42.190816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:42.191590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:42.192032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:42.252568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:42.260374 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1680cf60-2009-42d7-b179-0bacb0c522c8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.080963 May 10 14:47:42.260942 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1064/2031] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:43.277676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:43.278304 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:43.284727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:43.285178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:43.285949 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:43.286421 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:43.350737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:43.358450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e13a3f09-053b-4bb7-a82b-50805dcd5e4b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084691 May 10 14:47:43.359008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 968/2032] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:43 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:44.376147 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:44.376784 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:44.383809 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:44.384253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:44.385007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:44.385438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:44.445845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:44.453658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e60fbd9-d8ca-4c29-9489-b5a9e1aa3955 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081433 May 10 14:47:44.454234 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1065/2033] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:44 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:45.471521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:45.472158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:45.479196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:45.479643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:45.480414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:45.480848 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:45.545010 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:45.553454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09210eea-a5b1-4ebb-93db-d60bc4728da3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085294 May 10 14:47:45.554026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 969/2034] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:46.571083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:46.571686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:46.578024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:46.578498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:46.579252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:46.579681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:46.644674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:46.652617 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-23df351c-1be1-400c-aa4b-3c64d966ae6f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086248 May 10 14:47:46.653211 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1066/2035] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:46 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:47.669246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:47.672823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:47.676187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:47.676628 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:47.677393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:47.678756 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:47.744228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:47.752027 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-beda5abe-586c-4421-93fe-d2b5c08fc85b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086758 May 10 14:47:47.752593 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 970/2036] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:47 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:47:48.768988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:48.769850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:48.776671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:48.777127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:48.777905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:48.778387 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:48.844703 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:48.853914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c4c5adc7-74a2-4d2f-94a1-117c8d0de665 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088777 May 10 14:47:48.854533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1067/2037] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:49.871488 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:49.872070 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:49.878706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:49.878994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:49.879771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:49.880271 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:49.944704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:49.952926 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cec95c76-2be7-4576-a569-5d80efdb832b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085358 May 10 14:47:49.953501 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 971/2038] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:50.969515 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:50.970145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:50.976399 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:50.976788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:50.977568 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:50.978002 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:51.040505 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:51.048272 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-31372627-2a2f-41ad-aa78-2edd24b54297 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083244 May 10 14:47:51.048827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1068/2039] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:50 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:52.066341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:52.066953 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:52.074127 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:52.074615 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:52.075386 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:52.075825 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:52.139252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:52.147737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ef69122-b27e-48c1-9330-1e45f7d32ab7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085330 May 10 14:47:52.148548 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 972/2040] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:53.166249 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:53.166863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:53.173445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:53.174708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:53.174708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:53.175271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:53.239124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:53.247453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9aac06a-a17f-4d0a-aadf-93370ec7a477 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086409 May 10 14:47:53.248003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1069/2041] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:53 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:54.264563 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:54.265171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:54.271793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:54.272277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:54.273053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:54.273495 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:54.335219 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:54.343083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-419fa473-92dd-4d3b-b108-f39d4563b529 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082445 May 10 14:47:54.343648 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 973/2042] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:54 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:55.360046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:55.360645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:55.368264 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:55.368710 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:55.369464 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:55.369891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:55.431028 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:55.438870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c48a22e8-57e0-40b7-a6f0-c4f3e8878fb2 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082684 May 10 14:47:55.439431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1070/2043] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:55 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:56.456446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:56.457040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:56.463960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:56.464404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:56.465166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:56.465596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:56.528616 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:56.536334 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-11e18052-b013-47cc-98e7-3c2880faeed3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083775 May 10 14:47:56.537921 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 974/2044] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:57.554673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:57.555274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:57.561789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:57.562256 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:57.563016 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:57.563449 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:57.623640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:57.632081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-24b36c30-98dc-444e-9c65-0b1e057c8ea3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081921 May 10 14:47:57.632643 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1071/2045] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:58.649472 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:58.650076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:58.656438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:58.656882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:58.657644 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:58.658075 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:58.719816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:58.728294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4a9ff7e-575c-43d8-aa6e-a3645cd7a620 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083389 May 10 14:47:58.728854 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 975/2046] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:47:59.746660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:47:59.747275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:47:59.753920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:59.754420 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:59.755253 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:47:59.755688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:47:59.816992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:47:59.825303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b910aeb3-3cb6-4457-b859-6dc00d2185fa tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082464 May 10 14:47:59.825875 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1072/2047] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:47:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:00.843395 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:00.844073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:00.851123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:00.851573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:00.852351 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:00.852786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:00.918479 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:00.927041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4723985c-76ea-41ef-9b3c-9c444ecf1519 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087418 May 10 14:48:00.927619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 976/2048] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:01.943804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:01.944565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:01.951113 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:01.951795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:01.952301 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:01.952737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:02.020333 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:02.028867 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9eb2321d-0424-47df-8d60-c92ffa1cf15d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089237 May 10 14:48:02.029437 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1073/2049] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:03.227299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:03.227834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:03.233774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:03.234257 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:03.235080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:03.235510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:03.297499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:03.305539 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35668bd1-d59b-49ef-9ecc-e940b1ad13f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.263176 May 10 14:48:03.306109 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 977/2050] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:03 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:04.322709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:04.323284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:04.329520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:04.329970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:04.330752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:04.331180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:04.396127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:04.404276 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c57f83be-4906-4f07-9bdf-ec2733e7bd59 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085650 May 10 14:48:04.404842 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1074/2051] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:04 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:05.422121 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:05.422838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:05.429923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:05.430639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:05.431435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:05.431896 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:05.495707 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:05.503457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd83e145-c63e-4a46-9bdc-584ab55eb208 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085336 May 10 14:48:05.504015 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 978/2052] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:05 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:06.521968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:06.522594 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:06.528860 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:06.529303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:06.530057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:06.530523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:06.599078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:06.611659 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73d16917-039b-4a8d-b49a-2c8f298804be tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.094490 May 10 14:48:06.612232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1075/2053] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:06 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:07.628627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:07.629236 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:07.636652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:07.637104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:07.637868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:07.638334 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:07.698989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:07.706774 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d7ce41a5-a638-4f62-99bc-abd029b652ee tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081944 May 10 14:48:07.707339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 979/2054] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:07 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:08.724795 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:08.725403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:08.731658 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:08.732100 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:08.732853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:08.733281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:08.794470 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:08.802327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9f76333-06dd-4de6-a775-ac4d02233c7c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081866 May 10 14:48:08.802894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1076/2055] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:08 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:09.819900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:09.820506 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:09.826904 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:09.827359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:09.828166 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:09.828601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:09.889529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:09.897639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-28973d39-5261-4af9-b6dd-1172964021ba tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082488 May 10 14:48:09.898222 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 980/2056] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:09 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:10.914187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:10.914827 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:10.921183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:10.921629 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:10.922483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:10.922916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:10.983204 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:10.991986 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f3bfa009-370b-4eed-99bf-877d78a0f2f3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.081728 May 10 14:48:10.992554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1077/2057] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:10 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:12.010343 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:12.010920 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:12.017802 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:12.018258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:12.019043 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:12.019473 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:12.097580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:12.106489 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ce282a9-0f9a-4de5-bd14-04b989f75356 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.101428 May 10 14:48:12.107080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 981/2058] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:12 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:13.124425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:13.125024 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:13.132105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:13.132554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:13.133319 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:13.133757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:13.195804 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:13.203641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b8e614fa-a3e7-424c-a79b-e25f2d89939c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083191 May 10 14:48:13.204218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1078/2059] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:13 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:14.221484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:14.222074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:14.229016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:14.229468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:14.230274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:14.230715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:14.294026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:14.301975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70717038-e6e9-4def-ad57-262dca29a3a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084359 May 10 14:48:14.302564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 982/2060] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:14 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:15.320219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:15.320853 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:15.327394 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:15.327837 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:15.328702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:15.329262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:15.398535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:15.406409 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e088b94a-876b-44ed-9776-ff31dffd9bda tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.091150 May 10 14:48:15.406982 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1079/2061] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:15 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:16.425758 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:16.426704 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:16.435268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:16.435718 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:16.436492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:16.436923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:16.497878 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:16.505869 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c7169a9-81fd-4a7c-93f9-c6f3422f93f4 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085896 May 10 14:48:16.506464 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 983/2062] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:16 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:17.523348 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:17.523957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:17.530389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:17.530833 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:17.531591 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:17.532022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:17.594586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:17.603584 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-18124236-e250-45b6-a15e-7d5d5a52537a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084546 May 10 14:48:17.604169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1080/2063] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:17 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:18.621834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:18.622451 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:18.631187 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:18.631799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:18.632440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:18.632880 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:18.698503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:18.706532 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de9039af-9978-44a3-9a4c-a9e131e9f4ad tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088565 May 10 14:48:18.707382 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 984/2064] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:18 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:48:19.724003 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:19.724619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:19.730566 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:19.731014 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:19.731814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:19.732247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:19.793910 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:19.802262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e34e7f2c-9aae-4beb-a400-07e4a8ab5ddb tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082785 May 10 14:48:19.802824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1081/2065] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:19 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:20.819196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:20.819805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:20.826333 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:20.826775 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:20.827545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:20.827971 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:20.889675 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:20.898870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67ed9c47-0ab7-4509-961c-aeda29b3fc03 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083527 May 10 14:48:20.899456 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 985/2066] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:20 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:21.916790 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:21.917413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:21.923985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:21.924431 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:21.925198 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:21.925709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:21.993099 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:22.001890 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7d0efec2-2f60-4a10-882d-5432018ab910 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089158 May 10 14:48:22.002616 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1082/2067] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:21 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:23.020575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:23.021123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:23.027454 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:23.027903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:23.028669 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:23.029102 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:23.092907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:23.101067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-392bdc9c-0fce-4f89-a41e-6c786aeea64c tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084667 May 10 14:48:23.101623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 986/2068] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:23 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:24.118547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:24.119396 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:24.125497 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:24.125938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:24.126737 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:24.127174 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:24.189739 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:24.198757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-29390a43-47ae-4f93-9545-02715382c53f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084790 May 10 14:48:24.199341 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1083/2069] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:24 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:25.216053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:25.216676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:25.224632 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:25.225084 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:25.225864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:25.226327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:25.289654 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:25.297819 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f4de9d6-60fc-45f4-9b62-fb16007ca555 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085649 May 10 14:48:25.298435 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 987/2070] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:25 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:26.315544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:26.316146 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:26.324096 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:26.324554 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:26.325327 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:26.325767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:26.388098 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:26.396057 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7b9db0de-ba04-4ae9-8070-35975758eb31 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084382 May 10 14:48:26.396626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1084/2071] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:26 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:27.413527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:27.414135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:27.420763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:27.421214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:27.421988 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:27.422452 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:27.491938 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:27.499801 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4a034a7-a215-432f-8d45-bc852e52214d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.090903 May 10 14:48:27.500363 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 988/2072] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:27 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:28.516342 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:28.516959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:28.523888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:28.524332 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:28.525088 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:28.525521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:28.588689 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:28.596410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffe23ed0-27cb-4093-8fdb-b597840db793 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083955 May 10 14:48:28.596972 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1085/2073] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:28 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:29.615797 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:29.616424 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:29.622744 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:29.623186 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:29.623948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:29.624375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:29.686610 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:29.695178 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-afead747-6865-40d6-a868-6d01004099e9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084038 May 10 14:48:29.695743 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 989/2074] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:29 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:30.712106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:30.712704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:30.719065 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:30.719510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:30.720268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:30.720699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:30.783185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:30.791302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-092dee7b-7cde-4cfe-ba43-a0ca3a0048e5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083024 May 10 14:48:30.791872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1086/2075] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:30 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:31.808295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:31.808909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:31.815340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:31.815882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:31.816701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:31.817146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:31.891200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:31.891200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb58ced0-eace-4a04-9212-18dc1e3d0e61 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084947 May 10 14:48:31.891200 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 990/2076] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:31 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:32.908544 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:32.909185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:32.916436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:32.916888 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:32.917673 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:32.918164 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:32.984435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:32.993421 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9561c0d5-21fb-4289-a1d7-97067181c3c6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088665 May 10 14:48:32.994006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1087/2077] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:32 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:34.011174 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:34.011815 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:34.018459 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:34.018963 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:34.019977 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:34.020413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:34.081416 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:34.089402 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4c92b16-bf2d-46df-99fc-38040e8b8267 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082679 May 10 14:48:34.089968 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 991/2078] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:34 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:35.107006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:35.107609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:35.114407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:35.114870 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:35.115645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:35.116089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:35.178105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:35.186020 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07d06453-6831-426b-ba83-6bb33094a658 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082858 May 10 14:48:35.186605 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1088/2079] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:35 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:36.208440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:36.209580 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:36.218689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:36.219133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:36.219908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:36.220340 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:36.285839 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:36.293686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4646baf2-f653-4200-aa35-3ab689e4c8f1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.093699 May 10 14:48:36.294440 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 992/2080] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:36 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:37.312585 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:37.313183 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:37.320460 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:37.320901 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:37.321664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:37.322089 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:37.383444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:37.391593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8ed23420-b9b2-4f2f-9d34-e10b8338e77d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083962 May 10 14:48:37.392162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1089/2081] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:37 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:38.423509 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:38.424104 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:38.430908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:38.431363 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:38.432144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:38.432577 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:38.508469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:38.516465 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dda3e091-f331-4dd3-b0ec-686c3cc568ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.096897 May 10 14:48:38.517034 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 993/2082] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:38 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:39.534185 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:39.535363 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:39.541948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:39.542435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:39.543208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:39.543640 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:39.607433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:39.616508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93346e81-2192-4d55-965f-cf240d64b592 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086449 May 10 14:48:39.617128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1090/2083] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:39 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:40.633685 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:40.634447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:40.641051 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:40.641623 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:40.642446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:40.642913 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:40.706273 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:40.714432 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e654ff9-e284-4e5a-8ded-f4356fa48a99 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084665 May 10 14:48:40.715029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 994/2084] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:40 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:41.732128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:41.732733 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:41.739706 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:41.740148 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:41.740915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:41.741346 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:41.808261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:41.816512 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ad63232d-e142-4640-9487-2d0290d38c6e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.088119 May 10 14:48:41.817078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1091/2085] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:41 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:42.837241 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:42.837838 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:42.844614 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:42.845059 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:42.845835 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:42.846307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:42.912481 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:42.920888 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3323a15-2c8d-47d3-8379-8fb33b420efd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087586 May 10 14:48:42.921890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 995/2086] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:42 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:43.938586 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:43.939157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:43.946664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:43.947124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:43.947911 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:43.948354 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:44.010891 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:44.019660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d06bebe-9ced-4c38-8ec8-173f7e979df0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084855 May 10 14:48:44.020254 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1092/2087] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:43 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:45.037307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:45.037907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:45.044447 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:45.044890 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:45.045666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:45.046095 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:45.108787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:45.118461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e6637f6-3326-4285-a25a-5a24c54e243f tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086030 May 10 14:48:45.119029 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 996/2088] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:45 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:48:46.136370 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:46.136968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:46.143628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:46.144175 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:46.144957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:46.145398 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:46.206914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:46.214948 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bb092929-719e-4bb4-81da-fa19dd2e8505 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082490 May 10 14:48:46.215516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1093/2089] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:46 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:47.232693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:47.233288 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:47.241249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:47.241705 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:47.242500 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:47.242930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:47.305419 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:47.313466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70d90089-a92e-4326-8ab2-18f5a99f40d3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084705 May 10 14:48:47.314026 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 997/2090] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:47 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:48.332304 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:48.332918 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:48.339413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:48.339865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:48.340633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:48.341066 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:48.409459 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:48.417358 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-adb82dc1-42e3-433c-b6d1-b574e86ab8a9 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089894 May 10 14:48:48.417923 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1094/2091] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:48 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:49.434434 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:49.435124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:49.441533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:49.444570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:49.444570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:49.444570 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:49.505549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:49.513579 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cb423c5-0ebb-4818-83f3-44271920d188 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083202 May 10 14:48:49.514142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 998/2092] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:49 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:50.532951 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:50.533683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:50.539697 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:50.540143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:50.540907 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:50.541343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:50.603121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:50.611351 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-febeb0b0-9da4-48a6-bfdc-5c1886396429 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.082407 May 10 14:48:50.611937 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1095/2093] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:50 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:51.629771 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:51.630408 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:51.636817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:51.637262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:51.638041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:51.638490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:51.700780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:51.709053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67c58deb-de06-4507-b9d0-f635130bbeb7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.084305 May 10 14:48:51.709627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 999/2094] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:51 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:52.726644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:52.727267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:52.733845 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:52.734407 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:52.735221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:52.736022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:52.801145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:52.809281 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-34769546-9f47-43fd-a128-1225475357cf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.086263 May 10 14:48:52.809639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1096/2095] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:52 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:53.826694 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:53.827328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:53.834527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:53.834970 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:53.835745 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:53.836176 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:53.899376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:53.910503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb4109ee-88aa-47ce-b266-57375c93a41d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087856 May 10 14:48:53.911076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1000/2096] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:53 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:54.927994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:54.928644 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:54.934915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:54.935356 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:54.936106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:54.936540 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:55.000194 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:55.008683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f00e6126-28eb-4d6c-9acc-74f5ab110de0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085251 May 10 14:48:55.009252 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1097/2097] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:54 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:48:56.026446 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:56.027048 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:56.033448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:56.034008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:56.034693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:56.035134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:56.098365 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:56.106322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca54ed43-387d-4b6c-acf5-d2db2bc35374 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.083917 May 10 14:48:56.106894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1001/2098] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:56 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:57.124087 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:57.124637 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:57.131806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:57.132247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:57.133015 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:57.133444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:57.200850 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:57.210109 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ef17a36c-a2bd-44d3-958e-0e3069e15eb1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.089987 May 10 14:48:57.210702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1098/2099] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:57 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:58.227708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:58.228307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:58.234749 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:58.235199 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:58.236964 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:58.237612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:58.302763 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:58.310864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c546927d-a4e8-4f1c-9e90-163277d407d1 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.087055 May 10 14:48:58.311428 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1002/2100] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:58 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:48:59.327968 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:48:59.328577 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:48:59.335472 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:59.338258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:59.338258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:48:59.338258 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:48:59.400743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:48:59.409328 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5226b13f-adf2-4650-a8b6-21c6839cf24d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085297 May 10 14:48:59.409897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1099/2101] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:48:59 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:00.426411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:00.427065 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:00.433372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:00.433829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:00.434708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:00.435152 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:00.499162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:00.507908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64778edf-409c-44cf-865e-20f7316d7956 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.085505 May 10 14:49:00.508485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1003/2102] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:00 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:01.524799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:01.525423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:01.532369 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:01.533516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:01.534331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:01.534769 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:01.605679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:01.614595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dc6df4b6-3f78-49cc-80a1-080d1d2be9f0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 200 len: 1368 microversion: 2.1 time: 0.093573 May 10 14:49:01.615193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1100/2103] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:01 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:01.632945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d7676f82-4ac1-4e0e-9732-19abdc3d84bf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '.version_select at 0x7fef895ba4c0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:01.729367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d7676f82-4ac1-4e0e-9732-19abdc3d84bf tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632850092" status: 202 len: 0 microversion: 2.1 time: 0.100316 May 10 14:49:01.729982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1004/2104] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 10 14:49:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632850092 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:49:02.808362 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7964c891-a0b3-4b9a-ac4f-526febc9b25b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'create', calling method: .version_select at 0x7fef8955c3a0>, body: {"keypair": {"name": "tempest-keypair-551723579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcSumYzwt8Piv2oeIBjAhCIJEH1S2AwW81kO/X0yxuyDULQBeZcJsGu3tY7hhEEVzOXWe0oxvVVf/1vzSo9u/6MU1SNGsC7+uGFffuxqL7qlQCV4jg5IRHx38Io/Ok/jw=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:49:02.823597 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-7964c891-a0b3-4b9a-ac4f-526febc9b25b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:49:02.827976 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-7964c891-a0b3-4b9a-ac4f-526febc9b25b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for user 8d788b9560504c3795dbb623f10467cd and project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:49:02.936516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7964c891-a0b3-4b9a-ac4f-526febc9b25b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132766 May 10 14:49:02.937125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1101/2105] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:49:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:49:05.606291 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-864627899", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cad3622-a51c-4f86-9546-02c91d6a6cf7"}], "security_groups": [{"name": "tempest-securitygroup--911722698"}], "key_name": "tempest-keypair-551723579", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:49:05.714326 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] validate_networks() for [('9cad3622-a51c-4f86-9546-02c91d6a6cf7', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:49:06.002101 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:06.002924 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:06.009702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:06.010153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:06.010941 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:06.011582 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f HTTP/1.1 May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:49:06.029590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.058133 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '49da3bbb-c3f4-4beb-8c62-d2a44c42d23f'} May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:49:06.059154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.060864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.062625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:49:06.062625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-53af525c-a090-451a-8510-9ed7b7d7abd1 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 404 len: 111 microversion: 2.20 time: 0.031075 May 10 14:49:06.062625 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1102/2106] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 10 14:49:05 2022] DELETE /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 14:49:06.063714 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:06.064939 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:06.071339 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:06.072173 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:06.073595 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:06.074032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:06.088639 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f HTTP/1.1 May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:49:06.090180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.092247 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '49da3bbb-c3f4-4beb-8c62-d2a44c42d23f'} May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:49:06.093265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. May 10 14:49:06.094998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:49:06.097457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance 49da3bbb-c3f4-4beb-8c62-d2a44c42d23f could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:49:06.097457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e729709-b11e-4ad9-87b6-86a9e33626bc tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f" status: 404 len: 111 microversion: 2.20 time: 0.032695 May 10 14:49:06.097457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1103/2107] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:49:06 2022] GET /compute/v2.1/servers/49da3bbb-c3f4-4beb-8c62-d2a44c42d23f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 14:49:06.222258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:49:06.222689 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:49:06.223163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:49:06.223602 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:49:06.224146 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:49:06.233863 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:06.234346 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:06.235210 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:06.236091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:06.254163 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:49:06.258659 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Getting quotas for user 8d788b9560504c3795dbb623f10467cd and project 2a315adb7b214dceb03ed0aac50d2519. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:49:06.271716 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:49:06.273991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:49:06.431989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-655e528c-4902-4eab-b30c-997512befa14 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.830571 May 10 14:49:06.432641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1005/2108] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:49:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:49:06.443187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8749033f-0da9-4f86-9286-633d51c4bda0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:06.443819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8749033f-0da9-4f86-9286-633d51c4bda0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:06.500847 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8749033f-0da9-4f86-9286-633d51c4bda0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:06.508314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8749033f-0da9-4f86-9286-633d51c4bda0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1236 microversion: 2.1 time: 0.069515 May 10 14:49:06.517642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1104/2109] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:06 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:07.525861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-85cf2595-b441-451c-89f6-8250912047ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:07.526513 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-85cf2595-b441-451c-89f6-8250912047ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:07.582142 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-85cf2595-b441-451c-89f6-8250912047ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:07.588911 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-85cf2595-b441-451c-89f6-8250912047ae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1236 microversion: 2.1 time: 0.067611 May 10 14:49:07.589468 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1006/2110] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:07 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:49:08.613663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:08.614298 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:08.625857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:08.625857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:08.625857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:08.625857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:08.687679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:08.695661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c370b981-4b1c-4834-afdd-cc483891277b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1288 microversion: 2.1 time: 0.087183 May 10 14:49:08.696229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1105/2111] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:08 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:09.721693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:09.722830 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:09.729678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:09.730453 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:09.733661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:09.733661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:09.794585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:09.802188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3a495a0-5ea5-4064-9860-540cf1dbe7a6 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1306 microversion: 2.1 time: 0.085155 May 10 14:49:09.802780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1007/2112] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:09 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:10.821292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:10.822722 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:10.831105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:10.831565 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:10.832355 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:10.832782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:11.018742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:11.026118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cb42580a-9add-44be-b159-a14eb90b1cb0 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1361 microversion: 2.1 time: 0.208805 May 10 14:49:11.026726 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1106/2113] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:10 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:11.709378 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-9f6b9ddf-2c66-49d9-970a-22c644dbe28d req-c8ba4f32-b9e2-4520-be2a-7a7ed8eb3daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e91c9433-7035-4776-84d5-92f7315cec61", "tag": "b8efda33-b074-4d33-b713-c1ac44d4ae6b"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:49:11.717796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9f6b9ddf-2c66-49d9-970a-22c644dbe28d req-c8ba4f32-b9e2-4520-be2a-7a7ed8eb3daa service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:11.718527 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9f6b9ddf-2c66-49d9-970a-22c644dbe28d req-c8ba4f32-b9e2-4520-be2a-7a7ed8eb3daa service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:11.731317 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-9f6b9ddf-2c66-49d9-970a-22c644dbe28d req-c8ba4f32-b9e2-4520-be2a-7a7ed8eb3daa service nova] Creating event network-changed:b8efda33-b074-4d33-b713-c1ac44d4ae6b for instance e91c9433-7035-4776-84d5-92f7315cec61 on hv-cinder-84112 May 10 14:49:11.737275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-9f6b9ddf-2c66-49d9-970a-22c644dbe28d req-c8ba4f32-b9e2-4520-be2a-7a7ed8eb3daa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176086 May 10 14:49:11.737930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1008/2114] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:49:12.043718 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:12.044353 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:12.051435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:12.051895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:12.052755 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:12.053118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:12.220233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:12.227651 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a5551ee7-c7c2-4819-a92e-f8d0c0df2f97 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1361 microversion: 2.1 time: 0.187822 May 10 14:49:12.228218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1107/2115] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:12 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:49:13.246986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:13.247742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:13.255925 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:13.256405 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:13.257342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:13.257778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:13.413721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:13.421879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f769215-ebbd-4416-a161-b4d9694ee17a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1361 microversion: 2.1 time: 0.179921 May 10 14:49:13.422502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1009/2116] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:13 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:14.439165 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:14.439815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:14.446251 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:14.446711 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:14.447508 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:14.447944 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:14.670017 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:14.678560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-66af933b-c6dd-4a4c-bd18-83da46c8e488 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1361 microversion: 2.1 time: 0.243194 May 10 14:49:14.679011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1108/2117] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:14 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:15.695620 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:15.696228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:15.702932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:15.704301 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:15.704822 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:15.705267 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:15.839014 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:15.846936 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ed7ee2e-fc10-44f5-bd33-2a3753fc1268 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1361 microversion: 2.1 time: 0.155201 May 10 14:49:15.847509 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1010/2118] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:15 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:16.259856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-9a183864-92cd-4bdc-a639-420a6b08a003 req-772f00e0-87b4-4767-afb9-d84ca7333793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91c9433-7035-4776-84d5-92f7315cec61", "name": "network-vif-plugged", "status": "completed", "tag": "b8efda33-b074-4d33-b713-c1ac44d4ae6b"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:49:16.268645 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9a183864-92cd-4bdc-a639-420a6b08a003 req-772f00e0-87b4-4767-afb9-d84ca7333793 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:16.269083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9a183864-92cd-4bdc-a639-420a6b08a003 req-772f00e0-87b4-4767-afb9-d84ca7333793 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:16.280029 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-9a183864-92cd-4bdc-a639-420a6b08a003 req-772f00e0-87b4-4767-afb9-d84ca7333793 service nova] Creating event network-vif-plugged:b8efda33-b074-4d33-b713-c1ac44d4ae6b for instance e91c9433-7035-4776-84d5-92f7315cec61 on hv-cinder-84112 May 10 14:49:16.285688 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-9a183864-92cd-4bdc-a639-420a6b08a003 req-772f00e0-87b4-4767-afb9-d84ca7333793 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095570 May 10 14:49:16.286311 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1109/2119] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:49:16.864344 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:16.864958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:16.871780 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:16.872228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:16.873009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:16.873441 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:17.010164 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:17.017866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e4ba59e-743f-4bd0-a540-d57c2eb1f616 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1361 microversion: 2.1 time: 0.157730 May 10 14:49:17.018484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1011/2120] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:16 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:18.036569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:18.037218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:18.043674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:18.044142 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:18.044957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:18.045390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:18.177782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:18.185865 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-432f8c07-fa78-4b4d-847d-3616641fa681 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1361 microversion: 2.1 time: 0.154629 May 10 14:49:18.186483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1110/2121] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:18 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:49:19.204649 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:19.205268 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:19.211779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:19.212231 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:19.213002 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:19.213438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:19.349397 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:49:19.356945 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cff87e0a-1c87-417f-8df5-5d4106aff0ef tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1546 microversion: 2.1 time: 0.156561 May 10 14:49:19.357518 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1012/2122] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:49:19 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:49:19.373523 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2e243b1d-5e0d-488a-bbd3-b5e0035024e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:49:19.374121 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e243b1d-5e0d-488a-bbd3-b5e0035024e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:49:19.380708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e243b1d-5e0d-488a-bbd3-b5e0035024e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:19.381153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e243b1d-5e0d-488a-bbd3-b5e0035024e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:19.381913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e243b1d-5e0d-488a-bbd3-b5e0035024e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:19.382377 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e243b1d-5e0d-488a-bbd3-b5e0035024e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:19.460150 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2e243b1d-5e0d-488a-bbd3-b5e0035024e3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090594 May 10 14:49:19.460746 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1111/2123] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 10 14:49:19 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:49:20.543849 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d67fa5d1-0287-46ec-b212-9cf0612cf317 req-abcad1e2-496c-4106-b091-b26c7a5528ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e91c9433-7035-4776-84d5-92f7315cec61", "tag": "b8efda33-b074-4d33-b713-c1ac44d4ae6b"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:49:20.553091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d67fa5d1-0287-46ec-b212-9cf0612cf317 req-abcad1e2-496c-4106-b091-b26c7a5528ef service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:49:20.553529 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d67fa5d1-0287-46ec-b212-9cf0612cf317 req-abcad1e2-496c-4106-b091-b26c7a5528ef service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:49:20.564690 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d67fa5d1-0287-46ec-b212-9cf0612cf317 req-abcad1e2-496c-4106-b091-b26c7a5528ef service nova] Creating event network-changed:b8efda33-b074-4d33-b713-c1ac44d4ae6b for instance e91c9433-7035-4776-84d5-92f7315cec61 on hv-cinder-84112 May 10 14:49:20.569742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d67fa5d1-0287-46ec-b212-9cf0612cf317 req-abcad1e2-496c-4106-b091-b26c7a5528ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029555 May 10 14:49:20.570353 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1013/2124] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:50:35.640127 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-555af557-0add-4f52-96ee-9a47acc0ad5a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:50:35.640805 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-555af557-0add-4f52-96ee-9a47acc0ad5a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:50:35.646647 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-555af557-0add-4f52-96ee-9a47acc0ad5a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:50:35.647104 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-555af557-0add-4f52-96ee-9a47acc0ad5a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:50:35.647875 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-555af557-0add-4f52-96ee-9a47acc0ad5a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:50:35.648324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-555af557-0add-4f52-96ee-9a47acc0ad5a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:50:35.672444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-555af557-0add-4f52-96ee-9a47acc0ad5a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/ips" status: 200 len: 145 microversion: 2.1 time: 0.037684 May 10 14:50:35.673006 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1112/2125] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:50:35 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:51:57.362784 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f72e0f51-59d1-4534-b3ec-f971aca26b14] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 14:51:57.373523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0bbbe98c-3511-4ca7-8196-348a925344b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13f7ce6f-a321-40a4-a55f-7b31f30d283a"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:51:57.373523 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0bbbe98c-3511-4ca7-8196-348a925344b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:51:57.376786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bbbe98c-3511-4ca7-8196-348a925344b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:57.376786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bbbe98c-3511-4ca7-8196-348a925344b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:57.376786 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bbbe98c-3511-4ca7-8196-348a925344b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:57.377223 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bbbe98c-3511-4ca7-8196-348a925344b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:58.371666 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] [f72e0f51-59d1-4534-b3ec-f971aca26b14] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 39996. May 10 14:51:58.425796 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:51:58.426404 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:51:58.433709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:58.434162 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:58.434981 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:58.435402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:58.453105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 HTTP/1.1 May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:51:58.454819 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.456754 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9'} May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:51:58.457836 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.459463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.461832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:51:58.461832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3dfa6ee2-3b39-4f62-ac59-c5265abb7426 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 404 len: 111 microversion: 2.20 time: 0.035853 May 10 14:51:58.461832 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1113/2126] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 10 14:51:58 2022] DELETE /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 14:51:58.465280 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:51:58.465892 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] [instance: e7a50ebb-7db2-481e-a381-14f2aa6f3ec9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:51:58.472456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:58.472875 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:58.473632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:58.474094 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:58.498166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] HTTP exception thrown: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Request method failure captured: May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 HTTP/1.1 May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPFCkCEmd6hrGk0Rjpte6T6_nWEFUiqfSAnV1R5XXBYs24vTGBSYgw55Cnm6Qr3R3cLJ2VTnU9R6LCSWJpiEEWjrJJwP0ZaLOEvEVxBjxg9GQzYTmvkjbypVkMvULvJtFfjArj9o90rjKidtACcs6M33xJh8bsB3soXQxjxFfhzueU May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:51:58.499788 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8549d2b7b890411f878fe6fe776e65d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8549d2b7b890411f878fe6fe776e65d7"}]}] May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 8549d2b7b890411f878fe6fe776e65d7 May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2074249933 May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 9dae4d7a57f343c8bb7b92dbebea181d May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2074249933-project May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.505521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': 'e7a50ebb-7db2-481e-a381-14f2aa6f3ec9'} May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:51:58.508445 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. May 10 14:51:58.510056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:58.511535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] Returning 404 to user: Instance e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:51:58.511535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b55eecf8-2057-49c8-9067-fac1e2e86cd7 tempest-AttachVolumeShelveTestJSON-2074249933 tempest-AttachVolumeShelveTestJSON-2074249933-project] 10.222.0.58 "GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9" status: 404 len: 111 microversion: 2.20 time: 0.039512 May 10 14:51:58.511535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1114/2127] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 10 14:51:58 2022] GET /compute/v2.1/servers/e7a50ebb-7db2-481e-a381-14f2aa6f3ec9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:51:59.173387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0bbbe98c-3511-4ca7-8196-348a925344b8 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.812554 May 10 14:51:59.178820 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1014/2128] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:51:57 2022] POST /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments => generated 194 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:51:59.617858 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:51:59.618402 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:51:59.624430 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:59.625030 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:59.625679 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:59.626207 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:59.642800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 HTTP/1.1 May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:51:59.645045 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.646641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': 'aa87b0b7-2c67-463e-bed9-fba02f1215a8'} May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:51:59.686076 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.688159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:51:59.689619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:51:59.689619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4e70283-4870-4591-b67c-360757ee470d tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 404 len: 111 microversion: 2.1 time: 0.033291 May 10 14:51:59.689619 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1115/2129] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:51:59 2022] DELETE /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:51:59.689873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:51:59.689873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: aa87b0b7-2c67-463e-bed9-fba02f1215a8] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:51:59.689873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:59.689873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 HTTP/1.1 May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:51:59.690845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:51:59.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'aa87b0b7-2c67-463e-bed9-fba02f1215a8'} May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:51:59.695604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:51:59.699013 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:51:59.702715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:51:59.702715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. May 10 14:51:59.702715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:51:59.702715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance aa87b0b7-2c67-463e-bed9-fba02f1215a8 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:51:59.702715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0c650fb-118e-4062-a4ea-955f2a02ca5f tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8" status: 404 len: 111 microversion: 2.1 time: 0.034688 May 10 14:51:59.702715 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1015/2130] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:51:59 2022] GET /compute/v2.1/servers/aa87b0b7-2c67-463e-bed9-fba02f1215a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:04.824370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:04.825017 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:04.831573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:04.833542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:04.833542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:04.833542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:04.847445 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f HTTP/1.1 May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:04.849086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.851870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '51fb3f67-1347-46a8-aa95-3a656e9bc96f'} May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:04.852958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.854374 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.856031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:04.856031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-48e78577-6d51-4944-80e5-5a524831cd02 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 404 len: 111 microversion: 2.1 time: 0.030139 May 10 14:52:04.856031 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1016/2131] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:52:04 2022] DELETE /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:52:04.861439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:04.861439 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 51fb3f67-1347-46a8-aa95-3a656e9bc96f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:04.870295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:04.871853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:04.871853 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:04.872155 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:04.889818 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f HTTP/1.1 May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:04.891476 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.893275 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '51fb3f67-1347-46a8-aa95-3a656e9bc96f'} May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:04.894604 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. May 10 14:52:04.896512 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:04.898139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance 51fb3f67-1347-46a8-aa95-3a656e9bc96f could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:04.898139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-12602e99-3c7d-4e4b-98c6-30525131ef29 tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f" status: 404 len: 111 microversion: 2.1 time: 0.036795 May 10 14:52:04.898139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1017/2132] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:04 2022] GET /compute/v2.1/servers/51fb3f67-1347-46a8-aa95-3a656e9bc96f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:04.924588 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6faf2a51-631e-4ae6-a4b7-99c88195890f tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Action: 'create', calling method: .version_select at 0x7fef8444a8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-560252335", "metadata": {"Type": "work"}}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:52:05.878852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6faf2a51-631e-4ae6-a4b7-99c88195890f tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.129886 May 10 14:52:05.879479 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1116/2133] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 10 14:52:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1131 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 14:52:05.890760 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3ead24e-fbed-4e47-b9c5-8d5a4b638d2b tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Calling method '.version_select at 0x7fef894e24c0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:06.002158 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b3ead24e-fbed-4e47-b9c5-8d5a4b638d2b tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0" status: 200 len: 352 microversion: 2.1 time: 0.115434 May 10 14:52:06.002776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1018/2134] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:52:05 2022] GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:06.180499 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:06.181125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:06.187930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:06.188375 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:06.189345 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:06.189780 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:06.203343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 HTTP/1.1 May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:52:06.208193 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.210233 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': '2be793a1-f88b-4fb2-8e17-41545f3a5ee3'} May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:06.211227 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.212935 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:06.214661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:06.214661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4946f64-6aee-4909-a294-73d6639b3d2c tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 404 len: 111 microversion: 2.1 time: 0.030481 May 10 14:52:06.214661 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1117/2135] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:52:06 2022] DELETE /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:06.215733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:06.216339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] [instance: 2be793a1-f88b-4fb2-8e17-41545f3a5ee3] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:06.222510 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:06.222944 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:06.223708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:06.224139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:06.238384 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] HTTP exception thrown: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Request method failure captured: May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 HTTP/1.1 May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPI9XcgHSLZl_6yygP8b08djTlIR9am42OXxNlqYjHnv9jkO-5p80krfvfv1dPmwEB0HYl4ewHJk3Po4vgv2vFGxe75-oghlTTrliGves5zZAMRaP8AZGeOVgaN4u1Jm8Ytgbyum_iDIrys6ByraR9ULxroDFiZnMVcvl-uALT8d_c May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:06.240016 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc0e8bf4c69e49d1b4a44905d8c9bc98"}]}] May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: fc0e8bf4c69e49d1b4a44905d8c9bc98 May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580068953 May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: ecb4c97543e1452d8e6c8f1564addc76 May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1580068953-project May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.242613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '2be793a1-f88b-4fb2-8e17-41545f3a5ee3'} May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:06.243658 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. May 10 14:52:06.245144 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:06.254752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] Returning 404 to user: Instance 2be793a1-f88b-4fb2-8e17-41545f3a5ee3 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:06.254752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1286ab2-0ac1-46c5-8d9a-e92921943bfe tempest-AttachVolumeNegativeTest-1580068953 tempest-AttachVolumeNegativeTest-1580068953-project] 10.222.0.58 "GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3" status: 404 len: 111 microversion: 2.1 time: 0.030755 May 10 14:52:06.254752 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1019/2136] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:06 2022] GET /compute/v2.1/servers/2be793a1-f88b-4fb2-8e17-41545f3a5ee3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:07.014575 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3cd3058a-08ed-43aa-a4b5-4015c5285f98 tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Calling method '.version_select at 0x7fef847d7940>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:07.065823 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3cd3058a-08ed-43aa-a4b5-4015c5285f98 tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0" status: 200 len: 352 microversion: 2.1 time: 0.055015 May 10 14:52:07.066787 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1118/2137] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:52:07 2022] GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:08.094967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-917376eb-a114-45ad-b631-04195eab52c1 tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Calling method '.version_select at 0x7fef845d14c0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:08.155845 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-917376eb-a114-45ad-b631-04195eab52c1 tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0" status: 200 len: 353 microversion: 2.1 time: 0.081426 May 10 14:52:08.158245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1020/2138] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:52:08 2022] GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:08.169376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f21d0d06-113f-44a1-ae30-29d391636dcc tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Calling method '.version_select at 0x7fef895e73a0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:08.230463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f21d0d06-113f-44a1-ae30-29d391636dcc tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0" status: 200 len: 353 microversion: 2.1 time: 0.065601 May 10 14:52:08.234259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1119/2139] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:52:08 2022] GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:08.250322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3bcd2fbc-cee1-46ee-8a9e-5b7606f6e05b tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Calling method '.version_select at 0x7fef84677820>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:08.535961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3bcd2fbc-cee1-46ee-8a9e-5b7606f6e05b tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0" status: 202 len: 0 microversion: 2.1 time: 0.289014 May 10 14:52:08.540884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1021/2140] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:52:08 2022] DELETE /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:52:08.546365 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8aeb5e64-86f3-4b4f-87de-446479fa774c tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Calling method '.version_select at 0x7fef895e7310>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:08.611674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8aeb5e64-86f3-4b4f-87de-446479fa774c tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0" status: 200 len: 352 microversion: 2.1 time: 0.069921 May 10 14:52:08.612655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1120/2141] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:52:08 2022] GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:52:09.625130 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-215c89c9-40dc-415d-96f6-e9f543ea2f5d tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Calling method '.version_select at 0x7fef845d1e50>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:09.654559 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-215c89c9-40dc-415d-96f6-e9f543ea2f5d tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] HTTP exception thrown: Volume 134379ba-d239-43dc-8ebc-57f6b9eee7c0 could not be found. May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-215c89c9-40dc-415d-96f6-e9f543ea2f5d tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Request method failure captured: May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 HTTP/1.1 May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienwUIe6h6qVIFfnNwEtoU3F9t1VMhHwxnLeK6o7QTpMYxEVJlxyTxeIGuBIn0AvZRa_UCyPiryyG9FyVLgmqHaK9TyiNMEB7m2yXSO5izTgYFOPcY47Bnowx9TDvLNG7DDjucwJbIC-gexIORiFIh2TBr3U4JDDB57yMJ16Z-1bJ4R8 May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 4c2c44ecd51f4d73ab42fafc4750452e May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesGetTestJSON-445549349 May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:09.656502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4c2c44ecd51f4d73ab42fafc4750452e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4c2c44ecd51f4d73ab42fafc4750452e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4c2c44ecd51f4d73ab42fafc4750452e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4c2c44ecd51f4d73ab42fafc4750452e"}]}] May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesGetTestJSON-445549349 May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 4c2c44ecd51f4d73ab42fafc4750452e May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesGetTestJSON-445549349 May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesGetTestJSON-445549349-project May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 7ed1d7dae5d343fabafc9e28473eaf65 May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesGetTestJSON-445549349-project May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Volume 134379ba-d239-43dc-8ebc-57f6b9eee7c0 could not be found. May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '134379ba-d239-43dc-8ebc-57f6b9eee7c0'} May 10 14:52:09.658120 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 134379ba-d239-43dc-8ebc-57f6b9eee7c0 could not be found. (HTTP 404) (Request-ID: req-1d3deccd-4e28-4127-931f-068220f0c88b) May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:09.659208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:52:09.660627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 134379ba-d239-43dc-8ebc-57f6b9eee7c0 could not be found. May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:52:09.661976 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 134379ba-d239-43dc-8ebc-57f6b9eee7c0 could not be found. May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 134379ba-d239-43dc-8ebc-57f6b9eee7c0 could not be found. May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-215c89c9-40dc-415d-96f6-e9f543ea2f5d tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] Returning 404 to user: Volume 134379ba-d239-43dc-8ebc-57f6b9eee7c0 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-215c89c9-40dc-415d-96f6-e9f543ea2f5d tempest-VolumesGetTestJSON-445549349 tempest-VolumesGetTestJSON-445549349-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0" status: 404 len: 109 microversion: 2.1 time: 0.037168 May 10 14:52:09.665918 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1022/2142] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:52:09 2022] GET /compute/v2.1/os-volumes/134379ba-d239-43dc-8ebc-57f6b9eee7c0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:12.452266 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b3c01cab-c74d-42a0-98d9-125e51de6a84 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:12.456357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b3c01cab-c74d-42a0-98d9-125e51de6a84 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:12.461561 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3c01cab-c74d-42a0-98d9-125e51de6a84 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:12.462081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3c01cab-c74d-42a0-98d9-125e51de6a84 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:12.463195 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3c01cab-c74d-42a0-98d9-125e51de6a84 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:12.463815 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3c01cab-c74d-42a0-98d9-125e51de6a84 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:12.496400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b3c01cab-c74d-42a0-98d9-125e51de6a84 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 May 10 14:52:12.497480 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1121/2143] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:52:12 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:12.508041 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95878de5-959d-4452-b5e7-e4f5e1aa708e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:12.513650 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95878de5-959d-4452-b5e7-e4f5e1aa708e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:12.518083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95878de5-959d-4452-b5e7-e4f5e1aa708e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:12.518607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95878de5-959d-4452-b5e7-e4f5e1aa708e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:12.519639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95878de5-959d-4452-b5e7-e4f5e1aa708e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:12.520078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95878de5-959d-4452-b5e7-e4f5e1aa708e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:12.559701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95878de5-959d-4452-b5e7-e4f5e1aa708e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/13f7ce6f-a321-40a4-a55f-7b31f30d283a" status: 200 len: 194 microversion: 2.1 time: 0.052203 May 10 14:52:12.559701 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1023/2144] 10.222.0.58 () {58 vars in 1412 bytes} [Tue May 10 14:52:12 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/13f7ce6f-a321-40a4-a55f-7b31f30d283a => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:12.683200 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9d5f2dc-ba68-4ef6-9076-e20adc51b60e tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Action: 'create', calling method: .version_select at 0x7fef843c78b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-766401622", "metadata": {"Type": "work"}}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9d5f2dc-ba68-4ef6-9076-e20adc51b60e tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Request method failure captured: May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 121 May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienwczUvWcTOVQbWGPPbWZOrDi4yj7Ovd4Wf2mB0m0hqz8sncz_3qvrW7YQklHJoJl5e7sdflgw0zp4Cz55tzoRa2lt4KYhBEdJZq4PGuTDRIIa_LkXL24tndCpdT0dL7d2nr5VoGDvSlZJqfJlce_GRgos4VPowFzkbad5N9KCDhiDc May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:52:12.692748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f2d3eeb73834766abf555de78e7a23a"}]}] May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 1f792f2111a247bea71ed65ae2a61a6a May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-766401622", "metadata": {"Type": "work"}}} May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: May 10 14:52:12.695516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-766401622', 'metadata': {'Type': 'work'}}}} May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise error May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi '#$%' May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:12.696604 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 14:52:12.698338 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 14:52:12.701187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 14:52:12.701187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.701187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9d5f2dc-ba68-4ef6-9076-e20adc51b60e tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:12.701187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9d5f2dc-ba68-4ef6-9076-e20adc51b60e tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135160 May 10 14:52:12.701187 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1122/2145] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 10 14:52:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b95730d-0134-481e-816b-c21cac4ab543 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Action: 'create', calling method: .version_select at 0x7fef84503040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1629523992", "metadata": {"Type": "work"}}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b95730d-0134-481e-816b-c21cac4ab543 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Request method failure captured: May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 120 May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienwczUvWcTOVQbWGPPbWZOrDi4yj7Ovd4Wf2mB0m0hqz8sncz_3qvrW7YQklHJoJl5e7sdflgw0zp4Cz55tzoRa2lt4KYhBEdJZq4PGuTDRIIa_LkXL24tndCpdT0dL7d2nr5VoGDvSlZJqfJlce_GRgos4VPowFzkbad5N9KCDhiDc May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:12.714360 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f2d3eeb73834766abf555de78e7a23a"}]}] May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 1f792f2111a247bea71ed65ae2a61a6a May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1629523992", "metadata": {"Type": "work"}}} May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: May 10 14:52:12.718900 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1629523992', 'metadata': {'Type': 'work'}}}} May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise error May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi '0' May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:12.720008 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 14:52:12.721860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 14:52:12.724107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 14:52:12.724107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.724107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b95730d-0134-481e-816b-c21cac4ab543 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:12.724107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b95730d-0134-481e-816b-c21cac4ab543 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010894 May 10 14:52:12.724107 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1024/2146] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 10 14:52:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:52:12.724562 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc0d6f96-1c58-4138-b89f-aaf6da13bed2 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Action: 'create', calling method: .version_select at 0x7fef89503940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69280869", "metadata": {"Type": "work"}}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc0d6f96-1c58-4138-b89f-aaf6da13bed2 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Request method failure captured: May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 117 May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienwczUvWcTOVQbWGPPbWZOrDi4yj7Ovd4Wf2mB0m0hqz8sncz_3qvrW7YQklHJoJl5e7sdflgw0zp4Cz55tzoRa2lt4KYhBEdJZq4PGuTDRIIa_LkXL24tndCpdT0dL7d2nr5VoGDvSlZJqfJlce_GRgos4VPowFzkbad5N9KCDhiDc May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:52:12.726806 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f2d3eeb73834766abf555de78e7a23a"}]}] May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 1f792f2111a247bea71ed65ae2a61a6a May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69280869", "metadata": {"Type": "work"}}} May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: May 10 14:52:12.729290 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-69280869', 'metadata': {'Type': 'work'}}}} May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise error May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi '' May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:12.730392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 14:52:12.733774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 14:52:12.735357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 14:52:12.735357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.735357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc0d6f96-1c58-4138-b89f-aaf6da13bed2 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:12.735357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bc0d6f96-1c58-4138-b89f-aaf6da13bed2 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008065 May 10 14:52:12.735357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1123/2147] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 10 14:52:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 14:52:12.739269 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b678b31d-a877-4d45-bb59-81a2f963a9ea tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Calling method '.version_select at 0x7fef8427a8b0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:12.767484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-b678b31d-a877-4d45-bb59-81a2f963a9ea tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] HTTP exception thrown: Volume tempest-invalid-420135746 could not be found. May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b678b31d-a877-4d45-bb59-81a2f963a9ea tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Request method failure captured: May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-420135746 HTTP/1.1 May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienwczUvWcTOVQbWGPPbWZOrDi4yj7Ovd4Wf2mB0m0hqz8sncz_3qvrW7YQklHJoJl5e7sdflgw0zp4Cz55tzoRa2lt4KYhBEdJZq4PGuTDRIIa_LkXL24tndCpdT0dL7d2nr5VoGDvSlZJqfJlce_GRgos4VPowFzkbad5N9KCDhiDc May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:12.770310 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f2d3eeb73834766abf555de78e7a23a"}]}] May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 1f792f2111a247bea71ed65ae2a61a6a May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Volume tempest-invalid-420135746 could not be found. May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'tempest-invalid-420135746'} May 10 14:52:12.773307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-420135746 could not be found. (HTTP 404) (Request-ID: req-407eff0b-a769-4d63-b1ff-10bf2543da1b) May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.774627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:52:12.777575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-420135746 could not be found. May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:12.779505 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-420135746 could not be found. May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-420135746 could not be found. May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b678b31d-a877-4d45-bb59-81a2f963a9ea tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Returning 404 to user: Volume tempest-invalid-420135746 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b678b31d-a877-4d45-bb59-81a2f963a9ea tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-420135746" status: 404 len: 98 microversion: 2.1 time: 0.036430 May 10 14:52:12.781245 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1025/2148] 10.222.0.58 () {58 vars in 1214 bytes} [Tue May 10 14:52:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-420135746 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 14:52:12.789169 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f8b40145-110e-461a-aa75-83b72a741e0c tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005521 May 10 14:52:12.789774 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1124/2149] 10.222.0.58 () {58 vars in 1139 bytes} [Tue May 10 14:52:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 14:52:12.805123 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-300a356d-27b8-4825-a9f9-93fee947a0e5 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004315 May 10 14:52:12.805639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1026/2150] 10.222.0.58 () {58 vars in 1136 bytes} [Tue May 10 14:52:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 14:52:12.814879 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03f41913-ba96-4022-ab00-b3a29f28cae6 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Calling method '.version_select at 0x7fef895e7af0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:12.847011 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-03f41913-ba96-4022-ab00-b3a29f28cae6 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] HTTP exception thrown: Volume fbb4ad9f-9142-4982-9080-3677fdb7eb24 could not be found. May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03f41913-ba96-4022-ab00-b3a29f28cae6 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Request method failure captured: May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/os-volumes/fbb4ad9f-9142-4982-9080-3677fdb7eb24 HTTP/1.1 May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienwczUvWcTOVQbWGPPbWZOrDi4yj7Ovd4Wf2mB0m0hqz8sncz_3qvrW7YQklHJoJl5e7sdflgw0zp4Cz55tzoRa2lt4KYhBEdJZq4PGuTDRIIa_LkXL24tndCpdT0dL7d2nr5VoGDvSlZJqfJlce_GRgos4VPowFzkbad5N9KCDhiDc May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:52:12.848959 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f2d3eeb73834766abf555de78e7a23a"}]}] May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 1f792f2111a247bea71ed65ae2a61a6a May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Volume fbb4ad9f-9142-4982-9080-3677fdb7eb24 could not be found. May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': 'fbb4ad9f-9142-4982-9080-3677fdb7eb24'} May 10 14:52:12.851915 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbb4ad9f-9142-4982-9080-3677fdb7eb24 could not be found. (HTTP 404) (Request-ID: req-7e83fbae-7887-4f3f-b909-58b63d2dffdc) May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.852913 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:52:12.854439 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbb4ad9f-9142-4982-9080-3677fdb7eb24 could not be found. May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 14:52:12.861378 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbb4ad9f-9142-4982-9080-3677fdb7eb24 could not be found. May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbb4ad9f-9142-4982-9080-3677fdb7eb24 could not be found. May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03f41913-ba96-4022-ab00-b3a29f28cae6 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Returning 404 to user: Volume fbb4ad9f-9142-4982-9080-3677fdb7eb24 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-03f41913-ba96-4022-ab00-b3a29f28cae6 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/fbb4ad9f-9142-4982-9080-3677fdb7eb24" status: 404 len: 109 microversion: 2.1 time: 0.040848 May 10 14:52:12.862974 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1125/2151] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 10 14:52:12 2022] DELETE /compute/v2.1/os-volumes/fbb4ad9f-9142-4982-9080-3677fdb7eb24 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:12.864184 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ff4c466-fcf3-413d-a1cf-738f4c859c57 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Calling method '.version_select at 0x7fef84503790>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:12.904861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-8ff4c466-fcf3-413d-a1cf-738f4c859c57 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] HTTP exception thrown: Volume 5134e25f-8c31-4cac-88fa-61e2503b6761 could not be found. May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ff4c466-fcf3-413d-a1cf-738f4c859c57 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Request method failure captured: May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/os-volumes/5134e25f-8c31-4cac-88fa-61e2503b6761 HTTP/1.1 May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienwczUvWcTOVQbWGPPbWZOrDi4yj7Ovd4Wf2mB0m0hqz8sncz_3qvrW7YQklHJoJl5e7sdflgw0zp4Cz55tzoRa2lt4KYhBEdJZq4PGuTDRIIa_LkXL24tndCpdT0dL7d2nr5VoGDvSlZJqfJlce_GRgos4VPowFzkbad5N9KCDhiDc May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:12.906834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6f2d3eeb73834766abf555de78e7a23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6f2d3eeb73834766abf555de78e7a23a"}]}] May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 6f2d3eeb73834766abf555de78e7a23a May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1559027315 May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 1f792f2111a247bea71ed65ae2a61a6a May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1559027315-project May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Volume 5134e25f-8c31-4cac-88fa-61e2503b6761 could not be found. May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '5134e25f-8c31-4cac-88fa-61e2503b6761'} May 10 14:52:12.908366 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5134e25f-8c31-4cac-88fa-61e2503b6761 could not be found. (HTTP 404) (Request-ID: req-20b3a693-8581-46be-b902-e0a29d094ac4) May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.909420 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:52:12.910981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5134e25f-8c31-4cac-88fa-61e2503b6761 could not be found. May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:52:12.915866 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5134e25f-8c31-4cac-88fa-61e2503b6761 could not be found. May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5134e25f-8c31-4cac-88fa-61e2503b6761 could not be found. May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ff4c466-fcf3-413d-a1cf-738f4c859c57 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] Returning 404 to user: Volume 5134e25f-8c31-4cac-88fa-61e2503b6761 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ff4c466-fcf3-413d-a1cf-738f4c859c57 tempest-VolumesNegativeTest-1559027315 tempest-VolumesNegativeTest-1559027315-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5134e25f-8c31-4cac-88fa-61e2503b6761" status: 404 len: 109 microversion: 2.1 time: 0.050954 May 10 14:52:12.917403 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1027/2152] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 10 14:52:12 2022] GET /compute/v2.1/os-volumes/5134e25f-8c31-4cac-88fa-61e2503b6761 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:18.916331 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3bcf8618-dac3-48b6-b009-17772cfd392d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4918d41-978b-4019-b4d3-59e33b2fa06f"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:52:18.918192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3bcf8618-dac3-48b6-b009-17772cfd392d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:18.924476 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bcf8618-dac3-48b6-b009-17772cfd392d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:18.924930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bcf8618-dac3-48b6-b009-17772cfd392d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:18.925702 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bcf8618-dac3-48b6-b009-17772cfd392d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:18.926176 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bcf8618-dac3-48b6-b009-17772cfd392d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:19.772914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3bcf8618-dac3-48b6-b009-17772cfd392d tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "POST /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860373 May 10 14:52:19.773589 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1126/2153] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 10 14:52:18 2022] POST /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:34.031891 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de5fcfa8-60ae-4f5f-81bc-2defd0b60f32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:34.032860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de5fcfa8-60ae-4f5f-81bc-2defd0b60f32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:34.047074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de5fcfa8-60ae-4f5f-81bc-2defd0b60f32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:34.047074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de5fcfa8-60ae-4f5f-81bc-2defd0b60f32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:34.047074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de5fcfa8-60ae-4f5f-81bc-2defd0b60f32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:34.047074 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de5fcfa8-60ae-4f5f-81bc-2defd0b60f32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:34.089443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de5fcfa8-60ae-4f5f-81bc-2defd0b60f32 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062981 May 10 14:52:34.090246 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1028/2154] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:52:34 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:34.246624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0857876d-8591-42c6-8cb1-95e437601a47 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:34.246624 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0857876d-8591-42c6-8cb1-95e437601a47 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:34.252841 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0857876d-8591-42c6-8cb1-95e437601a47 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:34.253361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0857876d-8591-42c6-8cb1-95e437601a47 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:34.254552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0857876d-8591-42c6-8cb1-95e437601a47 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:34.255518 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0857876d-8591-42c6-8cb1-95e437601a47 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:34.293237 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0857876d-8591-42c6-8cb1-95e437601a47 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/13f7ce6f-a321-40a4-a55f-7b31f30d283a" status: 200 len: 194 microversion: 2.1 time: 0.056361 May 10 14:52:34.293934 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1127/2155] 10.222.0.58 () {58 vars in 1412 bytes} [Tue May 10 14:52:34 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/13f7ce6f-a321-40a4-a55f-7b31f30d283a => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:34.306289 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:34.306846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:34.313364 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:34.313832 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:34.314621 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:34.315052 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:34.405285 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lazy-loading 'services' on Instance uuid e91c9433-7035-4776-84d5-92f7315cec61 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:52:34.687619 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f49e6a5e-8b59-48e9-94ad-172b9497644b tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/13f7ce6f-a321-40a4-a55f-7b31f30d283a" status: 202 len: 0 microversion: 2.1 time: 0.386317 May 10 14:52:34.688381 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1029/2156] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:52:34 2022] DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/13f7ce6f-a321-40a4-a55f-7b31f30d283a => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:52:37.268590 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-106601c7-a8fc-4085-8994-7d43a7aa06a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:37.269218 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-106601c7-a8fc-4085-8994-7d43a7aa06a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:37.276117 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-106601c7-a8fc-4085-8994-7d43a7aa06a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:37.276570 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-106601c7-a8fc-4085-8994-7d43a7aa06a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:37.277347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-106601c7-a8fc-4085-8994-7d43a7aa06a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:37.277789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-106601c7-a8fc-4085-8994-7d43a7aa06a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:37.307949 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-106601c7-a8fc-4085-8994-7d43a7aa06a5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/d4918d41-978b-4019-b4d3-59e33b2fa06f" status: 200 len: 194 microversion: 2.1 time: 0.043267 May 10 14:52:37.311723 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1128/2157] 10.222.0.58 () {58 vars in 1412 bytes} [Tue May 10 14:52:37 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/d4918d41-978b-4019-b4d3-59e33b2fa06f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:37.319561 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:37.320143 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:37.327293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:37.327293 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:37.328322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:37.328322 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:37.409846 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lazy-loading 'services' on Instance uuid e91c9433-7035-4776-84d5-92f7315cec61 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:52:37.747719 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-248a0584-ed89-4bd3-809e-876d5298acd7 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/d4918d41-978b-4019-b4d3-59e33b2fa06f" status: 202 len: 0 microversion: 2.1 time: 0.432906 May 10 14:52:37.748325 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1030/2158] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 10 14:52:37 2022] DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments/d4918d41-978b-4019-b4d3-59e33b2fa06f => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:52:39.966877 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-593a5e66-bda9-4202-9027-85757db0ee1a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:39.967863 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-593a5e66-bda9-4202-9027-85757db0ee1a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:39.974641 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-593a5e66-bda9-4202-9027-85757db0ee1a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:39.975039 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-593a5e66-bda9-4202-9027-85757db0ee1a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:39.975812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-593a5e66-bda9-4202-9027-85757db0ee1a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:39.976259 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-593a5e66-bda9-4202-9027-85757db0ee1a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:40.007250 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-593a5e66-bda9-4202-9027-85757db0ee1a tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044291 May 10 14:52:40.008229 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1129/2159] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:52:39 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:52:40.124033 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff13601b-223b-4055-9ae0-0e2de5d51d71 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:40.125139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff13601b-223b-4055-9ae0-0e2de5d51d71 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:40.131950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff13601b-223b-4055-9ae0-0e2de5d51d71 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:40.132134 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff13601b-223b-4055-9ae0-0e2de5d51d71 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:40.133133 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff13601b-223b-4055-9ae0-0e2de5d51d71 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:40.133572 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff13601b-223b-4055-9ae0-0e2de5d51d71 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:40.165229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff13601b-223b-4055-9ae0-0e2de5d51d71 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046516 May 10 14:52:40.166022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1031/2160] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 10 14:52:40 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:52:40.231269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:40.234425 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:40.238376 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:40.239444 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:40.240219 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:40.240654 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:40.269129 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:52:40.610930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-59b2db8c-b208-4130-af84-7d8d82d7d817 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 204 len: 0 microversion: 2.1 time: 0.383832 May 10 14:52:40.611633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1130/2161] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:52:40 2022] DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:52:40.619961 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:40.620574 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:40.626873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:40.627375 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:40.628211 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:40.628652 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:40.791274 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:52:40.799296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22b9e710-6453-4797-8bc1-c4036597fbae tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1671 microversion: 2.1 time: 0.183198 May 10 14:52:40.799867 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1032/2162] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:40 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:52:41.818411 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:41.819462 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:41.825758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:41.826235 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:41.827157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:41.827822 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:41.970483 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:52:41.980516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1d2eea66-3cec-4537-a667-23d142fa8948 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1671 microversion: 2.1 time: 0.167133 May 10 14:52:41.981111 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1131/2163] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:41 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:52:42.999643 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:43.000286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:43.008483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:43.010132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:43.010132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:43.010448 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:43.149330 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:52:43.156713 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56f92354-c14c-4e8b-ba35-7c9d182ea861 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1671 microversion: 2.1 time: 0.162103 May 10 14:52:43.157286 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1033/2164] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:42 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:52:44.173704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:44.174412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:44.181669 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:44.182473 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:44.185914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:44.185914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:44.277748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:52:44.284898 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48db4476-5951-4382-b568-8ea521327867 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1604 microversion: 2.1 time: 0.115067 May 10 14:52:44.290232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1132/2165] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:44 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:52:44.617770 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-10234ec4-b5df-4fb8-8561-d925c656a559 req-2aa316b9-4675-4532-9ab4-a5bf6de16bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91c9433-7035-4776-84d5-92f7315cec61", "name": "network-vif-deleted", "tag": "b8efda33-b074-4d33-b713-c1ac44d4ae6b"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:52:44.651296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-10234ec4-b5df-4fb8-8561-d925c656a559 req-2aa316b9-4675-4532-9ab4-a5bf6de16bef service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:44.652229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-10234ec4-b5df-4fb8-8561-d925c656a559 req-2aa316b9-4675-4532-9ab4-a5bf6de16bef service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:44.676653 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-10234ec4-b5df-4fb8-8561-d925c656a559 req-2aa316b9-4675-4532-9ab4-a5bf6de16bef service nova] Creating event network-vif-deleted:b8efda33-b074-4d33-b713-c1ac44d4ae6b for instance e91c9433-7035-4776-84d5-92f7315cec61 on hv-cinder-84112 May 10 14:52:44.683507 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-10234ec4-b5df-4fb8-8561-d925c656a559 req-2aa316b9-4675-4532-9ab4-a5bf6de16bef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077110 May 10 14:52:44.684404 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1034/2166] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:52:45.307764 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:45.309558 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:45.334778 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:45.335288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:45.339400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:45.339400 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:45.419413 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:45.419861 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:45.420317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lazy-loading 'fault' on Instance uuid e91c9433-7035-4776-84d5-92f7315cec61 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:52:45.472004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d788b9560504c3795dbb623f10467cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a315adb7b214dceb03ed0aac50d2519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:52:45.493987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba40c527-a80e-4894-9c6e-65689fed66d5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 200 len: 1326 microversion: 2.1 time: 0.182194 May 10 14:52:45.493987 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1133/2167] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:45 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 1326 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:52:46.505721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:46.507234 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:46.513960 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:46.514442 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:46.515240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:46.515686 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:46.530895 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] HTTP exception thrown: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Request method failure captured: May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 HTTP/1.1 May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPPjChQQRJFezgPrCrKaZMxGBIN9I_aAgl92Yg6D50nx5s6cxDcg2F9i1FUUCse3FJINj-GdxNeURAO4rhSWM5tq--sqlTzFvnmXkz7uLcmwz8c474NdQ2QfG41hekBX7Vt5H6a-9u54h9E4QIru0KDzIGcUTJD8gUy8vSvreHrxNE May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:46.532601 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a315adb7b214dceb03ed0aac50d2519"}]}] May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 8d788b9560504c3795dbb623f10467cd May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:46.538903 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'e91c9433-7035-4776-84d5-92f7315cec61'} May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:46.540369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:46.542230 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:46.543876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Returning 404 to user: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:46.543876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73d604f5-9f8f-4bbf-a795-43253af8e057 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 404 len: 111 microversion: 2.1 time: 0.033871 May 10 14:52:46.543876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1035/2168] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:46 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:52:46.544157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e3c5120-0581-4697-b257-8eb79378e2b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '.version_select at 0x7fef8955c310>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:46.780283 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e3c5120-0581-4697-b257-8eb79378e2b3 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551723579" status: 202 len: 0 microversion: 2.1 time: 0.240058 May 10 14:52:46.780857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1134/2169] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 10 14:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551723579 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:52:50.346206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:50.346720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:50.354001 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:50.354538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:50.355387 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:50.355834 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:50.370294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] HTTP exception thrown: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Request method failure captured: May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 HTTP/1.1 May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPPjChQQRJFezgPrCrKaZMxGBIN9I_aAgl92Yg6D50nx5s6cxDcg2F9i1FUUCse3FJINj-GdxNeURAO4rhSWM5tq--sqlTzFvnmXkz7uLcmwz8c474NdQ2QfG41hekBX7Vt5H6a-9u54h9E4QIru0KDzIGcUTJD8gUy8vSvreHrxNE May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:50.371874 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a315adb7b214dceb03ed0aac50d2519"}]}] May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 8d788b9560504c3795dbb623f10467cd May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.373676 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'e91c9433-7035-4776-84d5-92f7315cec61'} May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:50.374861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.376646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:50.378533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Returning 404 to user: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:50.378533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ac278a5-6af7-487a-b2c5-f7b445326ec5 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 404 len: 111 microversion: 2.1 time: 0.030960 May 10 14:52:50.378533 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1036/2170] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:52:50 2022] DELETE /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:50.382103 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:50.393415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: e91c9433-7035-4776-84d5-92f7315cec61] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:50.393415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:50.393415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:50.393415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:50.393840 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:50.407153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] HTTP exception thrown: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Request method failure captured: May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 HTTP/1.1 May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPPjChQQRJFezgPrCrKaZMxGBIN9I_aAgl92Yg6D50nx5s6cxDcg2F9i1FUUCse3FJINj-GdxNeURAO4rhSWM5tq--sqlTzFvnmXkz7uLcmwz8c474NdQ2QfG41hekBX7Vt5H6a-9u54h9E4QIru0KDzIGcUTJD8gUy8vSvreHrxNE May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:52:50.408857 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a315adb7b214dceb03ed0aac50d2519"}]}] May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 8d788b9560504c3795dbb623f10467cd May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.410800 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': 'e91c9433-7035-4776-84d5-92f7315cec61'} May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:50.412007 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. May 10 14:52:50.413730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:50.415403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Returning 404 to user: Instance e91c9433-7035-4776-84d5-92f7315cec61 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:50.415403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d9c3e78a-49e2-48a4-b30c-cbe08aaa6d93 tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61" status: 404 len: 111 microversion: 2.1 time: 0.032487 May 10 14:52:50.415403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1135/2171] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:50 2022] GET /compute/v2.1/servers/e91c9433-7035-4776-84d5-92f7315cec61 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:52:51.795491 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:51.795996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:51.806496 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:51.806946 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:51.807720 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:51.808150 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:51.824214 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] HTTP exception thrown: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Request method failure captured: May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 HTTP/1.1 May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienPPjChQQRJFezgPrCrKaZMxGBIN9I_aAgl92Yg6D50nx5s6cxDcg2F9i1FUUCse3FJINj-GdxNeURAO4rhSWM5tq--sqlTzFvnmXkz7uLcmwz8c474NdQ2QfG41hekBX7Vt5H6a-9u54h9E4QIru0KDzIGcUTJD8gUy8vSvreHrxNE May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:52:51.825796 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a315adb7b214dceb03ed0aac50d2519"}]}] May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 8d788b9560504c3795dbb623f10467cd May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.827599 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'f9825c2a-925f-439c-835d-00b5aade9041'} May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:51.828502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.829881 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:52:51.831342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Returning 404 to user: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:51.831342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4e349b7c-f8f6-4922-a761-28711ae7666e tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 404 len: 111 microversion: 2.1 time: 0.037261 May 10 14:52:51.831342 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1037/2172] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:52:51 2022] DELETE /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:52:51.837317 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:52:51.837920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] [instance: f9825c2a-925f-439c-835d-00b5aade9041] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:52:51.844122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:51.844572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:51.845334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:52:51.845768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:52:51.860451 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] HTTP exception thrown: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Request method failure captured: May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 HTTP/1.1 May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept: application/json May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Connection: close May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Length: 0 May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Content-Type: application/json May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Host: 10.222.0.58 May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.9 May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABienPPjChQQRJFezgPrCrKaZMxGBIN9I_aAgl92Yg6D50nx5s6cxDcg2F9i1FUUCse3FJINj-GdxNeURAO4rhSWM5tq--sqlTzFvnmXkz7uLcmwz8c474NdQ2QfG41hekBX7Vt5H6a-9u54h9E4QIru0KDzIGcUTJD8gUy8vSvreHrxNE May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Id: None May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Domain-Name: None May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Role: reader,member May 10 14:52:51.862048 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Roles: reader,member May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a315adb7b214dceb03ed0aac50d2519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a315adb7b214dceb03ed0aac50d2519"}]}] May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 2a315adb7b214dceb03ed0aac50d2519 May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1375928986 May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Id: 8d788b9560504c3795dbb623f10467cd May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeTestJSON-1375928986-project May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: method: > May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: exception: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.864240 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: action_args: {'id': 'f9825c2a-925f-439c-835d-00b5aade9041'} May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:52:51.865964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. May 10 14:52:51.867831 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi May 10 14:52:51.869268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] Returning 404 to user: Instance f9825c2a-925f-439c-835d-00b5aade9041 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:52:51.869268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2d39ec09-3089-446c-89e6-d7f705c7fdbd tempest-AttachVolumeTestJSON-1375928986 tempest-AttachVolumeTestJSON-1375928986-project] 10.222.0.58 "GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041" status: 404 len: 111 microversion: 2.1 time: 0.030112 May 10 14:52:51.869268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1136/2173] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:52:51 2022] GET /compute/v2.1/servers/f9825c2a-925f-439c-835d-00b5aade9041 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:55:30.030908 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f72e0f51-59d1-4534-b3ec-f971aca26b14] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 14:55:30.034467 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-366960386", "imageRef": "52a2b324-51ea-4010-b407-208d3cb19121", "flavorRef": "452"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:30.086478 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] validate_networks() for None {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:55:30.381955 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:55:30.382591 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:55:30.382959 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:55:30.383407 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:55:30.383828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:55:30.393422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:30.393876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:30.394753 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:30.395196 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:30.412902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Getting quotas for project 4f78da2d8c0d41e1826839888feed24e. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:55:30.417019 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Getting quotas for user 9743c6c4397e496fb77fe02cabbe4fd3 and project 4f78da2d8c0d41e1826839888feed24e. Resources: {'instances', 'ram', 'cores'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:55:30.428137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:55:30.430569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52a2b324-51ea-4010-b407-208d3cb19121',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:55:30.618377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-435ca295-3ca1-4214-bcf6-cf4560333ee8 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590249 May 10 14:55:30.619571 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1038/2174] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:55:30.628856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd9701d5-076f-4d37-ba43-17a347a4bf7d] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 14:55:30.632734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-836afda1-eee8-42bf-93f8-6d4bbf1b1f44 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:30.633419 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-836afda1-eee8-42bf-93f8-6d4bbf1b1f44 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:30.688040 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-836afda1-eee8-42bf-93f8-6d4bbf1b1f44 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:30.695188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-836afda1-eee8-42bf-93f8-6d4bbf1b1f44 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1214 microversion: 2.1 time: 0.069142 May 10 14:55:30.695770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1137/2175] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:30 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:55:31.714782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-413437fc-d7b5-4db5-9e95-1da87be2718a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:31.715393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-413437fc-d7b5-4db5-9e95-1da87be2718a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:31.727877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] [f72e0f51-59d1-4534-b3ec-f971aca26b14] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 44060. May 10 14:55:31.799882 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-413437fc-d7b5-4db5-9e95-1da87be2718a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:31.806670 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-413437fc-d7b5-4db5-9e95-1da87be2718a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1214 microversion: 2.1 time: 0.096624 May 10 14:55:31.807242 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1039/2176] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:31 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:32.823920 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:32.827232 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:32.832314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:32.833056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:32.834104 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:32.834776 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:32.857265 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd9701d5-076f-4d37-ba43-17a347a4bf7d] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 44068. May 10 14:55:32.914453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:32.932269 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6894786e-2631-42e8-b7eb-a0be111fd93f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1210 microversion: 2.1 time: 0.112358 May 10 14:55:32.933060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1138/2177] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:32 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:33.954747 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:33.955371 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:33.966088 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:33.967372 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:33.967475 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:33.967857 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:34.088726 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:34.097101 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-43f2b5f7-ef17-4c0c-8538-822f999a3db5 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1272 microversion: 2.1 time: 0.146314 May 10 14:55:34.108076 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1040/2178] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:33 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:35.115248 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:35.115886 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:35.123502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:35.123958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:35.124738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:35.125202 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:35.200386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:35.208073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5883cfa3-c6b5-4bcd-a5d5-fb3735bb15c0 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1272 microversion: 2.1 time: 0.097039 May 10 14:55:35.208896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1139/2179] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:35 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:36.225789 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:36.226519 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:36.233887 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:36.235567 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:36.235816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:36.236414 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:36.531077 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:36.551096 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5be59e16-47ec-40bd-b0bf-e3bf6bba32fd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.329748 May 10 14:55:36.552009 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1041/2180] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:36 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:37.184812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-b84d336a-2daf-48b7-bc1a-b29ec21c30ec req-95dfb93b-28ff-4137-b407-c9292f26fccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400344f9-77ab-4e74-b756-1b67beef6b7a", "tag": "b9e94741-3ad7-4314-bfd0-25bb3c7ac59d"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:37.210110 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b84d336a-2daf-48b7-bc1a-b29ec21c30ec req-95dfb93b-28ff-4137-b407-c9292f26fccf service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:37.213047 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b84d336a-2daf-48b7-bc1a-b29ec21c30ec req-95dfb93b-28ff-4137-b407-c9292f26fccf service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:37.223885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-b84d336a-2daf-48b7-bc1a-b29ec21c30ec req-95dfb93b-28ff-4137-b407-c9292f26fccf service nova] Creating event network-changed:b9e94741-3ad7-4314-bfd0-25bb3c7ac59d for instance 400344f9-77ab-4e74-b756-1b67beef6b7a on hv-cinder-84112 May 10 14:55:37.240786 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-b84d336a-2daf-48b7-bc1a-b29ec21c30ec req-95dfb93b-28ff-4137-b407-c9292f26fccf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273034 May 10 14:55:37.243871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1140/2181] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:37.568331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:37.569080 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:37.576728 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:37.577369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:37.578396 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:37.578950 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:38.051079 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:38.059656 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-745d0505-7db2-4ca4-9a19-f333eaf098d1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.495355 May 10 14:55:38.061367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1042/2182] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:37 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:39.078177 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:39.079105 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:39.085538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:39.086054 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:39.087527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:39.088060 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:39.226900 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:39.235785 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-22627f8c-3f39-4b70-ade1-e7a3a702ac02 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.162281 May 10 14:55:39.246736 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1141/2183] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:39 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:55:40.253202 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:40.253928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:40.260778 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:40.261331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:40.262124 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:40.262589 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:40.564125 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:40.576521 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d24fb74-8bfc-43ca-9747-8b48344ddc03 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.327070 May 10 14:55:40.591035 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1043/2184] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:40 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:41.607642 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:41.609502 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:41.617447 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:41.629965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:41.629965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:41.629965 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:41.843803 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:41.854963 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e1a9b99-45c7-44a2-80d2-6624153328c3 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.252795 May 10 14:55:41.855859 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1142/2185] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:41 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:42.887884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:42.887884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:42.887884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:42.887884 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:42.888471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:42.888471 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:43.041411 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:43.048979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd2fe770-b833-4ae9-87bb-e2aa9d61d990 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.180791 May 10 14:55:43.059413 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1044/2186] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:42 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:44.066533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:44.067279 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:44.074324 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:44.074761 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:44.075533 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:44.075970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:44.390288 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:44.399321 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-45379113-ab8a-443e-aeee-f5765661456f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.336675 May 10 14:55:44.400389 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1143/2187] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:44 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:44.904847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-7214aea0-59f7-41da-a084-2c79dabef6f3 req-830acb1d-e082-46d4-bc1a-2ce101b10dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400344f9-77ab-4e74-b756-1b67beef6b7a", "name": "network-vif-plugged", "status": "completed", "tag": "b9e94741-3ad7-4314-bfd0-25bb3c7ac59d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:44.913261 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7214aea0-59f7-41da-a084-2c79dabef6f3 req-830acb1d-e082-46d4-bc1a-2ce101b10dec service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:44.913737 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7214aea0-59f7-41da-a084-2c79dabef6f3 req-830acb1d-e082-46d4-bc1a-2ce101b10dec service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:44.925831 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-7214aea0-59f7-41da-a084-2c79dabef6f3 req-830acb1d-e082-46d4-bc1a-2ce101b10dec service nova] Creating event network-vif-plugged:b9e94741-3ad7-4314-bfd0-25bb3c7ac59d for instance 400344f9-77ab-4e74-b756-1b67beef6b7a on hv-cinder-84112 May 10 14:55:44.932306 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-7214aea0-59f7-41da-a084-2c79dabef6f3 req-830acb1d-e082-46d4-bc1a-2ce101b10dec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279965 May 10 14:55:44.933484 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1045/2188] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:45.416228 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:45.416902 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:45.423318 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:45.423692 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:45.424672 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:45.425188 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:45.640086 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:45.656123 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3dd614d5-4adc-4175-8557-bc0c1b1878cc tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.242332 May 10 14:55:45.666868 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1144/2189] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:45 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:46.673768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:46.674509 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:46.682053 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:46.682868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:46.683875 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:46.684307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:46.852296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-95e9a3ab-f069-4603-bab0-670c24da5126 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Action: 'create', calling method: .version_select at 0x7fef8955c9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1151099727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/b+MUb01cnnjUlpDDYgcht7fgCON+S805vI4nb+sR869bYUQqrBsQP36qRy1r57FNYJK6etY177BXgIDyl4/IRJIrNuyqsPtPjhKX56rbX2jz8IUNKm/CsXDNeXJuDFw=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:46.866823 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:46.868852 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-95e9a3ab-f069-4603-bab0-670c24da5126 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Getting quotas for project 7ad02346a7e24c6ca4b182bb65090916. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:55:46.873263 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-95e9a3ab-f069-4603-bab0-670c24da5126 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Getting quotas for user edfc0d3911964db6b35768373ddb8237 and project 7ad02346a7e24c6ca4b182bb65090916. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:55:46.879458 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e968aeb2-7d04-44ce-b3b3-e578f4b6247a tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1314 microversion: 2.1 time: 0.209351 May 10 14:55:46.895746 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1046/2190] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:46 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:47.014507 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-95e9a3ab-f069-4603-bab0-670c24da5126 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.310805 May 10 14:55:47.020106 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1145/2191] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 10 14:55:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:55:47.986294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:47.986294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:47.986294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:47.986294 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:47.988543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:47.988543 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:48.128425 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:48.142232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-05d5de83-adee-4389-88ab-69dd2ad7dbb1 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1463 microversion: 2.1 time: 0.240604 May 10 14:55:48.179341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1047/2192] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:47 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:48.186648 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:48.187500 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:48.201546 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:48.203797 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:48.204871 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:48.205520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:48.249626 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:55:48.565208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-caed6c48-ad54-448f-a5e7-4ef217eaaee4 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "DELETE /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 204 len: 0 microversion: 2.1 time: 0.383610 May 10 14:55:48.565922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1146/2193] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 14:55:48 2022] DELETE /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:55:48.574352 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:48.584596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:48.584596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:48.584596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:48.584596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:48.584979 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:48.747229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:48.755956 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f97a97a-d579-4c9f-8416-11085fbb33cd tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1469 microversion: 2.1 time: 0.185510 May 10 14:55:48.764018 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1048/2194] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:48 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:49.780386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:49.780386 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:49.785334 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:49.785995 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:49.786872 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:49.787388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:49.937992 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:49.946894 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b777d703-60a4-47fd-b980-7aa62a0a654f tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1469 microversion: 2.1 time: 0.175219 May 10 14:55:49.947864 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1147/2195] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:49 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:55:50.853975 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-17741933-9522-42b3-ac7e-982b1241bef4 req-666b273e-3d68-4e3e-97ff-ece0aae50e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400344f9-77ab-4e74-b756-1b67beef6b7a", "name": "network-vif-deleted", "tag": "b9e94741-3ad7-4314-bfd0-25bb3c7ac59d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:55:50.870981 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-17741933-9522-42b3-ac7e-982b1241bef4 req-666b273e-3d68-4e3e-97ff-ece0aae50e54 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:50.871923 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-17741933-9522-42b3-ac7e-982b1241bef4 req-666b273e-3d68-4e3e-97ff-ece0aae50e54 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:50.886151 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-17741933-9522-42b3-ac7e-982b1241bef4 req-666b273e-3d68-4e3e-97ff-ece0aae50e54 service nova] Creating event network-vif-deleted:b9e94741-3ad7-4314-bfd0-25bb3c7ac59d for instance 400344f9-77ab-4e74-b756-1b67beef6b7a on hv-cinder-84112 May 10 14:55:50.891537 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-17741933-9522-42b3-ac7e-982b1241bef4 req-666b273e-3d68-4e3e-97ff-ece0aae50e54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045798 May 10 14:55:50.892213 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1049/2196] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:55:50.968734 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:50.970033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:50.980268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:50.981315 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:50.982388 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:50.983042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:51.058501 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9743c6c4397e496fb77fe02cabbe4fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f78da2d8c0d41e1826839888feed24e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:55:51.067035 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0add4a14-5495-49a6-9cbe-b869062e4b31 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 200 len: 1427 microversion: 2.1 time: 0.105581 May 10 14:55:51.068268 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1148/2197] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:50 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:55:52.090966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:55:52.090966 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] [instance: 400344f9-77ab-4e74-b756-1b67beef6b7a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:55:52.094111 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:52.094584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:52.095376 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:55:52.095814 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:55:52.112232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] HTTP exception thrown: Instance 400344f9-77ab-4e74-b756-1b67beef6b7a could not be found. May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Request method failure captured: May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a HTTP/1.1 May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienzfODz9pDxDiWjiwXuh7rj2fiFWrgXOasYftdJRVOULWHP4g4Eg5KJK_ToTgQa5ckFmVoi1LTEIbNCIHZHysBowxmyPozsWRMovd58KbgDslPRajZcCt8hMAV3v31KA-JAhcPgigP5LtwPftgLyS9TDskW4ZuH-cXEgaawUdDqcp3Y May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 4f78da2d8c0d41e1826839888feed24e May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-882737876 May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 14:55:52.114237 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f78da2d8c0d41e1826839888feed24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f78da2d8c0d41e1826839888feed24e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f78da2d8c0d41e1826839888feed24e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f78da2d8c0d41e1826839888feed24e"}]}] May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-882737876 May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 4f78da2d8c0d41e1826839888feed24e May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-882737876 May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-882737876-project May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: 9743c6c4397e496fb77fe02cabbe4fd3 May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-882737876-project May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance 400344f9-77ab-4e74-b756-1b67beef6b7a could not be found. May 10 14:55:52.116550 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': '400344f9-77ab-4e74-b756-1b67beef6b7a'} May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400344f9-77ab-4e74-b756-1b67beef6b7a could not be found. May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:55:52.118573 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400344f9-77ab-4e74-b756-1b67beef6b7a could not be found. May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400344f9-77ab-4e74-b756-1b67beef6b7a could not be found. May 10 14:55:52.121182 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 14:55:52.127249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] Returning 404 to user: Instance 400344f9-77ab-4e74-b756-1b67beef6b7a could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:55:52.127249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d99e73e-1e9d-49d3-8ebb-0bb7d9f87244 tempest-VolumesNegativeTest-882737876 tempest-VolumesNegativeTest-882737876-project] 10.222.0.58 "GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a" status: 404 len: 111 microversion: 2.1 time: 0.034394 May 10 14:55:52.127249 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1050/2198] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:55:52 2022] GET /compute/v2.1/servers/400344f9-77ab-4e74-b756-1b67beef6b7a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:56:24.934593 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1602404286", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1151099727", "security_groups": [{"name": "tempest-secgroup-smoke-371106792"}], "networks": [{"uuid": "dce02c1d-8257-43a5-a8a8-f204fc5fafa0"}], "block_device_mapping_v2": [{"uuid": "e68c40d1-d02c-4743-86f6-32b764aadbf6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:25.048916 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] validate_networks() for [('dce02c1d-8257-43a5-a8a8-f204fc5fafa0', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:56:25.538114 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:56:25.538772 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:56:25.539255 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:56:25.539666 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:56:25.540082 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:56:25.548768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:25.550676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:25.550676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:25.550676 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:25.567279 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Getting quotas for project 7ad02346a7e24c6ca4b182bb65090916. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:56:25.573655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Getting quotas for user edfc0d3911964db6b35768373ddb8237 and project 7ad02346a7e24c6ca4b182bb65090916. Resources: {'instances', 'ram', 'cores'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:56:25.638613 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:56:25.640682 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e68c40d1-d02c-4743-86f6-32b764aadbf6',volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:56:26.256709 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ac4a1dad-4108-4867-b3de-8b1e1491e96d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.325397 May 10 14:56:26.257701 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1149/2199] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 10 14:56:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:56:26.268198 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-572bc5c3-5999-47ba-be63-181eff170bb7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:26.268807 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-572bc5c3-5999-47ba-be63-181eff170bb7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:26.325922 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-572bc5c3-5999-47ba-be63-181eff170bb7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:26.332994 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-572bc5c3-5999-47ba-be63-181eff170bb7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1089 microversion: 2.1 time: 0.068764 May 10 14:56:26.333762 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1051/2200] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:26 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:27.352122 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9317ce6a-3ce7-4312-9a46-398895e07860 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:27.352728 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9317ce6a-3ce7-4312-9a46-398895e07860 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:27.405578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9317ce6a-3ce7-4312-9a46-398895e07860 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:27.413567 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9317ce6a-3ce7-4312-9a46-398895e07860 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1089 microversion: 2.1 time: 0.064454 May 10 14:56:27.414156 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1150/2201] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:27 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:28.433240 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:28.433860 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:28.440336 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:28.440779 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:28.441545 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:28.441978 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:28.506832 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:28.514378 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70863ff9-fa6c-4aef-9f30-64ef3787efeb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1131 microversion: 2.1 time: 0.085027 May 10 14:56:28.514872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1052/2202] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:28 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1131 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:29.532273 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:29.532905 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:29.539994 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:29.540433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:29.541192 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:29.541620 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:29.630285 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:29.638990 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73e40de9-d161-4e89-82a0-05d8f65012b3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1195 microversion: 2.1 time: 0.110699 May 10 14:56:29.640025 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1151/2203] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:29 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1195 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:30.657733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:30.658711 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:30.665805 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:30.666277 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:30.667091 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:30.667531 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:30.868915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:30.879477 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4436d2b4-a066-406e-b11b-51343eba1c49 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1272 microversion: 2.1 time: 0.226511 May 10 14:56:30.880075 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1053/2204] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:30 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:31.697461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-ea8e6e35-6b9c-4925-85f4-29ac950ff7b4 req-af3ba639-f6ba-4ec8-ae67-54273d4a2d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9edbc6-e7d3-4841-8865-8baa2a0dff40", "tag": "e9a40575-e81f-472b-8221-872f3c0a58b0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:31.706181 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-ea8e6e35-6b9c-4925-85f4-29ac950ff7b4 req-af3ba639-f6ba-4ec8-ae67-54273d4a2d9a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:31.716410 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-ea8e6e35-6b9c-4925-85f4-29ac950ff7b4 req-af3ba639-f6ba-4ec8-ae67-54273d4a2d9a service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:31.723633 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-ea8e6e35-6b9c-4925-85f4-29ac950ff7b4 req-af3ba639-f6ba-4ec8-ae67-54273d4a2d9a service nova] Creating event network-changed:e9a40575-e81f-472b-8221-872f3c0a58b0 for instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 on hv-cinder-84112 May 10 14:56:31.731535 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-ea8e6e35-6b9c-4925-85f4-29ac950ff7b4 req-af3ba639-f6ba-4ec8-ae67-54273d4a2d9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037810 May 10 14:56:31.732667 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1152/2205] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:31.902462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:31.903068 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:31.909803 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:31.920646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:31.920646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:31.920646 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:32.202693 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:32.211499 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5cedaa4c-ba81-4da9-8a61-7423b08cc0ff tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.312958 May 10 14:56:32.212078 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1054/2206] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:31 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:33.230527 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:33.231216 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:33.237531 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:33.237967 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:33.238799 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:33.239390 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:33.370962 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:33.378559 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-614af855-0a2b-4a34-b56e-16df24d83964 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.152607 May 10 14:56:33.379124 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1153/2207] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:33 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:34.395836 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:34.396457 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:34.403377 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:34.403829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:34.415517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:34.415517 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:34.537991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:34.546637 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b245e687-f46f-49ef-9646-636d0088ad04 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.154017 May 10 14:56:34.547238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1055/2208] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:34 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:35.564296 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:35.565081 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:35.574289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:35.574744 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:35.575520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:35.575957 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:35.727360 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:35.736998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-03fbdbfd-c4cf-41dc-8423-33a3264876de tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.176590 May 10 14:56:35.737816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1154/2209] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:35 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:36.754444 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:36.755033 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:36.762012 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:36.762491 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:36.763258 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:36.763688 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:36.894809 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:36.903233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81377ee9-4867-4980-ad00-8198b3d0dfa2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.152856 May 10 14:56:36.903850 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1056/2210] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:36 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:37.922042 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:37.922579 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:37.931885 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:37.932429 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:37.933201 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:37.933632 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:38.082768 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:38.092289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-78d351c1-512a-4f9b-a79a-d63b2dc9b66f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.175646 May 10 14:56:38.093056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1155/2211] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:37 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:39.109942 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:39.110514 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:39.117170 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:39.117611 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:39.118422 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:39.118873 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:39.271828 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:39.279915 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3904893c-1cee-4af2-9247-a873bac08b8a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.173891 May 10 14:56:39.280490 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1057/2212] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:39 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:40.299433 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:40.300036 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:40.306468 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:40.306917 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:40.307683 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:40.308125 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:40.453537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:40.453537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0fb55901-bf6d-4021-b9ce-92e551b79a4b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.153308 May 10 14:56:40.453537 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1156/2213] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:40 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:41.467608 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:41.470015 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:41.475341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:41.475782 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:41.476555 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:41.476982 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:41.631485 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:41.640379 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ec2cc36-8577-4e8d-9403-ebb0340f83a9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.177601 May 10 14:56:41.640954 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1058/2214] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:41 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:42.658412 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:42.659056 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:42.666073 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:42.666552 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:42.667330 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:42.667767 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:42.807300 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:42.814816 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0b128e92-71ce-4f47-bf67-2434c05da55e tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.160465 May 10 14:56:42.815397 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1157/2215] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:42 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:43.831858 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:43.832461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:43.839139 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:43.839590 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:43.840359 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:43.840794 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:43.973989 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:43.981586 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e86f02cb-c653-401c-905b-5b424b5473f6 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.153743 May 10 14:56:43.982335 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1059/2216] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:43 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:44.999660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:45.000225 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:45.007347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:45.007677 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:45.008453 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:45.008897 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:45.146520 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:45.153820 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e2cece6-04fa-4161-8f8a-2b5edc20a1aa tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.158171 May 10 14:56:45.154423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1158/2217] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:44 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:45.191894 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d61f7b7e-0a07-458e-91e3-10957373985e req-8527e11d-dfd7-4122-b30f-a0d8d9517017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9edbc6-e7d3-4841-8865-8baa2a0dff40", "name": "network-vif-plugged", "status": "completed", "tag": "e9a40575-e81f-472b-8221-872f3c0a58b0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:45.201773 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d61f7b7e-0a07-458e-91e3-10957373985e req-8527e11d-dfd7-4122-b30f-a0d8d9517017 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:45.202228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d61f7b7e-0a07-458e-91e3-10957373985e req-8527e11d-dfd7-4122-b30f-a0d8d9517017 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:45.213940 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d61f7b7e-0a07-458e-91e3-10957373985e req-8527e11d-dfd7-4122-b30f-a0d8d9517017 service nova] Creating event network-vif-plugged:e9a40575-e81f-472b-8221-872f3c0a58b0 for instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 on hv-cinder-84112 May 10 14:56:45.218842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d61f7b7e-0a07-458e-91e3-10957373985e req-8527e11d-dfd7-4122-b30f-a0d8d9517017 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030660 May 10 14:56:45.219430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1060/2218] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:56:46.170824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:46.171435 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:46.178306 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:46.178698 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:46.179457 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:46.179889 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:46.307438 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:46.315004 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2e909117-e067-44ac-9cc5-f789cd734d0c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1260 microversion: 2.1 time: 0.148138 May 10 14:56:46.315560 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1159/2219] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:46 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:47.334708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:47.335430 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:47.341538 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:47.341983 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:47.342811 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:47.343368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:47.474081 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:47.481851 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61c02b25-9a99-4054-a73e-e4e0ede4619f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1445 microversion: 2.1 time: 0.153101 May 10 14:56:47.482462 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1061/2220] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:47 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:47.497884 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:56:47.498522 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:56:47.505478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:47.506610 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:47.506721 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:47.507157 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:47.637033 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:56:47.644340 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-607db295-8f32-44f7-841e-c6aaafe426f9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1445 microversion: 2.1 time: 0.150293 May 10 14:56:47.644914 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1160/2221] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:56:47 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:56:50.108238 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-eae765a6-0189-491a-b6f3-8d8b9b79792f req-810db10f-7182-4d78-9c4f-c6ae032a2a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9edbc6-e7d3-4841-8865-8baa2a0dff40", "tag": "e9a40575-e81f-472b-8221-872f3c0a58b0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:56:50.116757 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-eae765a6-0189-491a-b6f3-8d8b9b79792f req-810db10f-7182-4d78-9c4f-c6ae032a2a9d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:56:50.117191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-eae765a6-0189-491a-b6f3-8d8b9b79792f req-810db10f-7182-4d78-9c4f-c6ae032a2a9d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:56:50.130909 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-eae765a6-0189-491a-b6f3-8d8b9b79792f req-810db10f-7182-4d78-9c4f-c6ae032a2a9d service nova] Creating event network-changed:e9a40575-e81f-472b-8221-872f3c0a58b0 for instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 on hv-cinder-84112 May 10 14:56:50.136389 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-eae765a6-0189-491a-b6f3-8d8b9b79792f req-810db10f-7182-4d78-9c4f-c6ae032a2a9d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032029 May 10 14:56:50.137283 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1062/2222] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:59:03.697139 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:59:03.697727 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:03.704128 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:03.704580 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:03.705985 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:03.706461 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:03.730344 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lazy-loading 'flavor' on Instance uuid ce9edbc6-e7d3-4841-8865-8baa2a0dff40 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:59:04.109455 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e74deb0a-4a6d-4817-ac2d-e5717140631a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "POST /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40/action" status: 202 len: 0 microversion: 2.1 time: 0.417226 May 10 14:59:04.110051 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1161/2223] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:59:03 2022] POST /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:59:04.120651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:04.121356 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:04.128588 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:04.129039 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:04.129816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:04.130307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:04.375661 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:04.383295 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-580f50c8-4d03-407f-b778-10176f105697 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.267870 May 10 14:59:04.383861 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1063/2224] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:04 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:05.401678 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:05.402403 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:05.408893 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:05.409347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:05.410112 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:05.410571 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:05.593759 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:05.601812 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-61ef56bb-9f15-4d72-a4f5-95074c154bec tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.205003 May 10 14:59:05.602392 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1162/2225] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:05 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:06.619986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:06.620584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:06.627638 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:06.628085 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:06.628856 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:06.629290 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:06.764115 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:06.772564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0cfe12c2-dc9a-4255-bca3-1e98db25422f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.156487 May 10 14:59:06.773141 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1064/2226] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:06 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:07.789478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:07.790078 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:07.796482 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:07.796908 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:07.797663 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:07.798090 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:07.925463 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:07.932904 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-83f440cf-6f5f-4929-bbe7-2a3b644fa329 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.147341 May 10 14:59:07.933478 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1163/2227] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:07 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:08.950135 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:08.950816 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:08.958137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:08.958597 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:08.959358 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:08.959787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:09.091732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:09.099706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c8d22bf-4c16-402b-89a1-bf183552256c tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.153530 May 10 14:59:09.100266 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1065/2228] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:08 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:10.116896 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:10.117538 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:10.123621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:10.124077 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:10.124849 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:10.125289 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:10.332601 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:10.339970 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cff2203b-4d55-40b9-8ef7-a812b8464b71 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.226738 May 10 14:59:10.340547 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1164/2229] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:10 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:11.364734 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:11.365368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:11.372099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:11.372549 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:11.373678 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:11.373793 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:11.507727 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:11.515162 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f9e9bc6-ecd0-497f-b01b-eaf345c800a3 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.160774 May 10 14:59:11.515732 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1066/2230] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:11 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:59:12.533158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:12.534572 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:12.541279 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:12.542655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:12.542655 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:12.542955 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:12.678236 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:12.685699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fbcf9068-96df-41f1-9dc5-cd60e6f413ba tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.156434 May 10 14:59:12.686578 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1165/2231] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:12 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:13.703370 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:13.704024 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:13.710879 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:13.711339 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:13.712130 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:13.712564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:13.866985 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:13.875086 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c3e0a27-a891-439d-9caf-bd72aa74e0c1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.175912 May 10 14:59:13.875673 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1067/2232] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:13 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:14.893660 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:14.894320 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:14.900707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:14.901186 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:14.901943 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:14.902423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:15.032210 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:15.041038 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-65dea507-8d0b-45dd-8af3-1c6b11a187b1 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.151931 May 10 14:59:15.041612 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1166/2233] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:14 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:16.058680 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:16.059292 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:16.065980 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:16.066463 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:16.067252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:16.067683 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:16.197431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:16.204916 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f1dd358-4671-4608-83a3-65d8c371a5b9 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.150057 May 10 14:59:16.205492 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1068/2234] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:16 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:17.222467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:17.223083 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:17.229467 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:17.229919 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:17.230704 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:17.231143 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:17.365810 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:17.373093 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ad9ecbd-c6ac-4928-b654-7ba7eeea96d5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.154957 May 10 14:59:17.373670 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1167/2235] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:17 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:18.391022 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:18.391625 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:18.398992 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:18.399443 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:18.400205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:18.400639 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:18.547585 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:18.555627 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4c6b1de-626b-4c47-a5b3-5e0b9e27d87f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.168492 May 10 14:59:18.556188 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1069/2236] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:18 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:19.572830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:19.573440 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:19.579851 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:19.580303 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:19.581080 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:19.581516 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:19.795217 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:19.804180 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6af7fdc8-50fa-46e3-a6ca-5c2f9f81a3cd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.235172 May 10 14:59:19.804757 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1168/2237] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:19 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:20.821776 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:20.822417 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:20.828721 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:20.829171 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:20.830168 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:20.830733 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:20.966235 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:20.975328 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c0290ee-dfb4-4121-b386-121e691ae7f4 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.157058 May 10 14:59:20.975613 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1070/2238] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:20 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:21.992621 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:21.993274 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:21.999557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:22.000010 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:22.000782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:22.001789 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:22.130664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:22.138005 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2e09244d-1d14-406e-8998-11c8ded36634 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.149261 May 10 14:59:22.138628 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1169/2239] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:21 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:23.156612 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:23.157331 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:23.164607 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:23.165568 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:23.165888 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:23.166369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:23.304660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:23.315972 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dfe0b53e-367e-4eaf-91d3-e33743ff211b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1570 microversion: 2.1 time: 0.163247 May 10 14:59:23.316547 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1071/2240] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:23 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:59:23.335599 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0916a399-31da-4c74-b86e-a8f2fd8a33ea tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:59:23.336158 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0916a399-31da-4c74-b86e-a8f2fd8a33ea tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:23.342541 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0916a399-31da-4c74-b86e-a8f2fd8a33ea tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:23.342993 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0916a399-31da-4c74-b86e-a8f2fd8a33ea tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:23.347978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0916a399-31da-4c74-b86e-a8f2fd8a33ea tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:23.347978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0916a399-31da-4c74-b86e-a8f2fd8a33ea tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:23.564953 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0916a399-31da-4c74-b86e-a8f2fd8a33ea tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "POST /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40/action" status: 202 len: 0 microversion: 2.1 time: 0.232399 May 10 14:59:23.565742 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1170/2241] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 10 14:59:23 2022] POST /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:59:23.573663 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:23.574302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:23.580928 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:23.581378 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:23.582193 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:23.582742 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:23.712967 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:23.721232 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e562a591-388b-432b-b8c8-ee9e1b58525f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1518 microversion: 2.1 time: 0.151010 May 10 14:59:23.726228 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1072/2242] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:23 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:24.739206 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:24.739844 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:24.747292 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:24.747738 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:24.748540 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:24.748978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:24.880208 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:24.887707 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-850c5278-cd45-4e02-9547-1d540bde1f6b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1518 microversion: 2.1 time: 0.152749 May 10 14:59:24.888275 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1171/2243] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:24 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:25.905984 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:25.906817 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:25.914393 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:25.914847 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:25.915761 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:25.916191 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:25.943930 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-b61de710-3ccf-4437-81b6-f0a631a5f344 req-f4534df1-01e8-42b6-8389-039fb1557aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9edbc6-e7d3-4841-8865-8baa2a0dff40", "name": "network-vif-unplugged", "status": "completed", "tag": "e9a40575-e81f-472b-8221-872f3c0a58b0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:59:25.953326 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b61de710-3ccf-4437-81b6-f0a631a5f344 req-f4534df1-01e8-42b6-8389-039fb1557aee service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:25.953777 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b61de710-3ccf-4437-81b6-f0a631a5f344 req-f4534df1-01e8-42b6-8389-039fb1557aee service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:25.966261 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.compute.server_external_events [req-b61de710-3ccf-4437-81b6-f0a631a5f344 req-f4534df1-01e8-42b6-8389-039fb1557aee service nova] Unable to find a host for instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40. Dropping event network-vif-unplugged {{(pid=117661) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 14:59:25.966824 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-b61de710-3ccf-4437-81b6-f0a631a5f344 req-f4534df1-01e8-42b6-8389-039fb1557aee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027611 May 10 14:59:25.967569 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1172/2244] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 10 14:59:26.073502 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:26.084189 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-93239d68-cc15-4446-88c8-9f4c5bdf7056 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1520 microversion: 2.1 time: 0.181980 May 10 14:59:26.084783 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1073/2245] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:25 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:27.102922 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:27.103474 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:27.110988 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:27.111443 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:27.112231 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:27.112671 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:27.436481 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:27.444770 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b0706740-4bd2-449d-9c5c-d3c97aefbefc tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.346176 May 10 14:59:27.445347 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1173/2246] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:27 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:28.461073 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:28.461708 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:28.468129 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:28.468596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:28.469368 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:28.469808 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:28.605229 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:28.613569 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-103798d8-31ef-4e51-a078-d2056ed74975 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.156425 May 10 14:59:28.614140 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1074/2247] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:28 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:29.631284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:29.631925 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:29.638284 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:29.638735 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:29.639498 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:29.639945 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:29.774818 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:29.781989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-28c3611c-3486-40f8-972b-8ec983e7becb tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.154655 May 10 14:59:29.783222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1174/2248] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:29 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:30.799431 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:30.800036 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:30.806650 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:30.807099 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:30.807868 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:30.808302 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:30.942373 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:30.949986 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e00c3034-c127-4aa6-9617-14b4a5c8ded2 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.154480 May 10 14:59:30.950575 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1075/2249] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:30 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:31.968415 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:31.969019 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:31.983494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:31.983494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:31.983494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:31.983494 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:32.111506 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:32.116323 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f6ba95e3-2e5d-4202-9800-0878b5ac07b7 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.151833 May 10 14:59:32.116964 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1175/2250] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:31 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:33.132998 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:33.133605 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:33.139596 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:33.140040 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:33.140800 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:33.141221 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:33.272843 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:33.280205 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13dd66c2-6fd7-44f7-888e-4e2281979afd tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.151243 May 10 14:59:33.280765 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1076/2251] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:33 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:34.297856 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:34.299116 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:34.305145 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:34.305583 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:34.306366 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:34.306811 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:34.435361 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:34.443752 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7efc4734-ee1d-4e7a-a709-715c5228779f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.149879 May 10 14:59:34.444312 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1176/2252] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:34 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:35.461341 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:35.461948 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:35.468262 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:35.468706 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:35.469469 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:35.469930 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:35.597554 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:35.604799 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5ae8a25-804e-4899-bd26-00e612927388 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.147365 May 10 14:59:35.605369 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1077/2253] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:35 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:36.622357 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:36.622926 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:36.629938 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:36.630495 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:36.631309 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:36.631743 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:36.770686 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:36.778135 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-52267835-108d-4e4e-88b3-5f2ad49a3fd5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.160054 May 10 14:59:36.778730 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1177/2254] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:36 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:37.795296 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:37.795902 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:37.802542 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:37.802996 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:37.803768 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:37.804206 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:37.935932 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:37.944410 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4feed8a-d418-477d-b545-74868c19a0c5 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.152852 May 10 14:59:37.945067 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1078/2255] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:37 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:38.962699 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:38.963221 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:38.970454 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:38.971529 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:38.972314 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:38.972748 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:39.115074 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:39.122814 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2b5fad27-947d-472a-915e-871fe0bc0a7f tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.164197 May 10 14:59:39.123391 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1178/2256] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:38 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:40.035842 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-014c6efb-7f7b-4cd1-a1fa-22aabcb7f69d req-6cc83613-65fb-448a-a752-3152b4bbcc37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9edbc6-e7d3-4841-8865-8baa2a0dff40", "name": "network-vif-plugged", "status": "completed", "tag": "e9a40575-e81f-472b-8221-872f3c0a58b0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:59:40.044327 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-014c6efb-7f7b-4cd1-a1fa-22aabcb7f69d req-6cc83613-65fb-448a-a752-3152b4bbcc37 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:40.044787 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-014c6efb-7f7b-4cd1-a1fa-22aabcb7f69d req-6cc83613-65fb-448a-a752-3152b4bbcc37 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:40.057660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-014c6efb-7f7b-4cd1-a1fa-22aabcb7f69d req-6cc83613-65fb-448a-a752-3152b4bbcc37 service nova] Creating event network-vif-plugged:e9a40575-e81f-472b-8221-872f3c0a58b0 for instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 on hv-cinder-84112 May 10 14:59:40.062958 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-014c6efb-7f7b-4cd1-a1fa-22aabcb7f69d req-6cc83613-65fb-448a-a752-3152b4bbcc37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 May 10 14:59:40.063651 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1079/2257] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 14:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:59:40.139874 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:40.140521 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:40.148222 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:40.148674 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:40.149456 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:40.149895 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:40.286530 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:40.294958 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-86c2022d-606c-4541-ad7e-a01c9c746e48 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.158945 May 10 14:59:40.295690 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1179/2258] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:40 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:41.314864 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:41.315552 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:41.321641 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:41.322083 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:41.322872 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:41.323299 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:41.459829 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:41.466859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da1b5627-f0ee-4e55-ab62-052e0c3e6e7b tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1576 microversion: 2.1 time: 0.157347 May 10 14:59:41.467461 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1080/2259] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:41 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:59:42.484159 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:59:42.485032 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:59:42.492061 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:42.492504 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:42.493271 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:59:42.494241 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:59:42.630681 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:59:42.637969 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bd038b91-609f-46ab-a6d5-278c25af4220 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1563 microversion: 2.1 time: 0.157692 May 10 14:59:42.638557 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1180/2260] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 14:59:42 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:01:12.489503 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:12.490090 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:01:12.497859 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:12.498367 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:12.499307 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:12.499924 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:12.530999 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 15:01:12.567302 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-fb5db75f-dd6e-4e0b-a2ed-4c0557ac267d req-bfdabdd2-a1ab-45dd-a3e5-8f77889c7d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9edbc6-e7d3-4841-8865-8baa2a0dff40", "tag": "e9a40575-e81f-472b-8221-872f3c0a58b0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:01:12.576750 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-fb5db75f-dd6e-4e0b-a2ed-4c0557ac267d req-bfdabdd2-a1ab-45dd-a3e5-8f77889c7d03 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:12.577830 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-fb5db75f-dd6e-4e0b-a2ed-4c0557ac267d req-bfdabdd2-a1ab-45dd-a3e5-8f77889c7d03 service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:12.590064 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-fb5db75f-dd6e-4e0b-a2ed-4c0557ac267d req-bfdabdd2-a1ab-45dd-a3e5-8f77889c7d03 service nova] Creating event network-changed:e9a40575-e81f-472b-8221-872f3c0a58b0 for instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 on hv-cinder-84112 May 10 15:01:12.596044 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-fb5db75f-dd6e-4e0b-a2ed-4c0557ac267d req-bfdabdd2-a1ab-45dd-a3e5-8f77889c7d03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109648 May 10 15:01:12.596664 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1181/2261] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 15:01:12.883218 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ce3c204-a049-40fd-9016-02985821cd0a tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 204 len: 0 microversion: 2.1 time: 0.400744 May 10 15:01:12.884450 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1081/2262] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 10 15:01:12 2022] DELETE /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 15:01:12.893712 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:12.895118 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:01:12.901782 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:12.902267 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:12.903068 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:12.903510 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:13.040978 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:01:13.049022 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e8d40b92-b0c6-41cd-8edf-d11e60739d28 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.160207 May 10 15:01:13.049609 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1182/2263] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 15:01:12 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:01:14.067668 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:14.068357 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:01:14.076252 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:14.078226 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:14.079137 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:14.079876 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:14.277540 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:01:14.278907 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50742133-cd10-4931-8f28-eab5009f291d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1569 microversion: 2.1 time: 0.215476 May 10 15:01:14.279466 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1082/2264] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 15:01:14 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:01:15.234423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-6483c133-9f2c-4980-a96d-469d7b114928 req-478a42fc-d672-476f-a2e4-3fb4c5f9b67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9edbc6-e7d3-4841-8865-8baa2a0dff40", "name": "network-vif-deleted", "tag": "e9a40575-e81f-472b-8221-872f3c0a58b0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 15:01:15.234423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6483c133-9f2c-4980-a96d-469d7b114928 req-478a42fc-d672-476f-a2e4-3fb4c5f9b67d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:15.234423 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6483c133-9f2c-4980-a96d-469d7b114928 req-478a42fc-d672-476f-a2e4-3fb4c5f9b67d service nova] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:15.246152 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-6483c133-9f2c-4980-a96d-469d7b114928 req-478a42fc-d672-476f-a2e4-3fb4c5f9b67d service nova] Creating event network-vif-deleted:e9a40575-e81f-472b-8221-872f3c0a58b0 for instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 on hv-cinder-84112 May 10 15:01:15.252855 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-6483c133-9f2c-4980-a96d-469d7b114928 req-478a42fc-d672-476f-a2e4-3fb4c5f9b67d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034636 May 10 15:01:15.255046 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1183/2265] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 10 15:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 15:01:15.297201 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:15.297841 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:01:15.304279 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:15.307769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:15.307769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:15.307769 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:15.371592 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:01:15.380660 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f287de6-7610-459b-827d-6dcce2dbed33 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1384 microversion: 2.1 time: 0.087753 May 10 15:01:15.381233 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1083/2266] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 15:01:15 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1384 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:01:16.400278 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:16.401055 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:01:16.407989 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:16.408436 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:16.409262 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:16.409693 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:16.445166 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:16.445708 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:16.446153 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lazy-loading 'fault' on Instance uuid ce9edbc6-e7d3-4841-8865-8baa2a0dff40 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 15:01:16.492154 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfc0d3911964db6b35768373ddb8237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad02346a7e24c6ca4b182bb65090916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} May 10 15:01:16.501343 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60ebe240-0f0f-4aeb-9ba7-25cc07a42c18 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 200 len: 1225 microversion: 2.1 time: 0.105717 May 10 15:01:16.501998 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1184/2267] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 15:01:16 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 15:01:17.519877 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:17.520483 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] [instance: ce9edbc6-e7d3-4841-8865-8baa2a0dff40] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 15:01:17.526991 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:17.527438 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:17.528208 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 15:01:17.528633 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Lock "164fd8b6-494f-4056-845b-5dc9e7551c56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 15:01:17.542870 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] HTTP exception thrown: Instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 could not be found. May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Request method failure captured: May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 HTTP/1.1 May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept: application/json May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Connection: close May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Length: 0 May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Content-Type: application/json May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Host: 10.222.0.58 May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABienzqooy5WOxpeH4Dceoqm7LkTl15HFY25W6HfD9dryN0AoPybZV68z4q5Ga-KJ0A3uDFVrTZah4hs04ENa6wYTqfmkltdufhc0wX0RRS-ulcEMAt29fn2BG_w02J_TK6fInUIekgJvD2YUaEKoD4AGFAu-0j2urZpP0bIyK0NYhIbGc May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Id: None May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Domain-Name: None May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Id: 7ad02346a7e24c6ca4b182bb65090916 May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestShelveInstance-1008981555 May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Role: reader,member May 10 15:01:17.544564 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Roles: reader,member May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad02346a7e24c6ca4b182bb65090916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad02346a7e24c6ca4b182bb65090916"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad02346a7e24c6ca4b182bb65090916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad02346a7e24c6ca4b182bb65090916"}]}] May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestShelveInstance-1008981555 May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 7ad02346a7e24c6ca4b182bb65090916 May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestShelveInstance-1008981555 May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User: tempest-TestShelveInstance-1008981555-project May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Id: edfc0d3911964db6b35768373ddb8237 May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestShelveInstance-1008981555-project May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: method: > May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: exception: Instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 could not be found. May 10 15:01:17.546311 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: action_args: {'id': 'ce9edbc6-e7d3-4841-8865-8baa2a0dff40'} May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 could not be found. May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 15:01:17.547132 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 could not be found. May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 could not be found. May 10 15:01:17.548584 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi May 10 15:01:17.549740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Returning 404 to user: Instance ce9edbc6-e7d3-4841-8865-8baa2a0dff40 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 15:01:17.549740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8031d820-0e97-4f4e-b949-311075a82c0d tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40" status: 404 len: 111 microversion: 2.1 time: 0.030995 May 10 15:01:17.549740 dv-cinder-841125-4-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1084/2268] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 10 15:01:17 2022] GET /compute/v2.1/servers/ce9edbc6-e7d3-4841-8865-8baa2a0dff40 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 15:01:17.796408 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fdf9a32d-215d-49d5-93dd-7ded6e67ff74 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] Calling method '.version_select at 0x7fef89503820>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 15:01:17.878137 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fdf9a32d-215d-49d5-93dd-7ded6e67ff74 tempest-TestShelveInstance-1008981555 tempest-TestShelveInstance-1008981555-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1151099727" status: 202 len: 0 microversion: 2.1 time: 0.086385 May 10 15:01:17.878758 dv-cinder-841125-4-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1185/2269] 10.222.0.58 () {58 vars in 1253 bytes} [Tue May 10 15:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1151099727 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)